Compare model types with Hyperopt and MLflow
Note
The open-source version of Hyperopt is no longer being maintained.
Hyperopt will no longer be pre-installed on Databricks Runtime ML 17.0 and above. Databricks recommends using Optuna instead for a similar experience and access to more up-to-date hyperparameter tuning algorithms.
This notebook demonstrates how to tune the hyperparameters for multiple models and arrive at a best model overall. It uses Hyperopt with SparkTrials
to compare three model types, evaluating model performance with a different set of hyperparameters appropriate for each model type.