Compare model types with Hyperopt and MLflow

Note

The open-source version of Hyperopt is no longer being maintained.

Hyperopt will be removed in the next major DBR ML version. Databricks recommends using either Optuna for single-node optimization or RayTune for a similar experience to the deprecated Hyperopt distributed hyperparameter tuning functionality. Learn more about using RayTune on Databricks.

This notebook demonstrates how to tune the hyperparameters for multiple models and arrive at a best model overall. It uses Hyperopt with SparkTrials to compare three model types, evaluating model performance with a different set of hyperparameters appropriate for each model type.

Compare models using scikit-learn, Hyperopt, and MLflow notebook

Open notebook in new tab Copy link for import