How-To: Distributed Hyperparameter Search

Optimizing ML algorithm hyperparameters is a numbers game; the more options you explore, the higher likelihood of landing on the best model. Learn how to distribute hyperparameter computations across your Kubernetes cluster.

You will need a Dataiku DSS instance set up to run with containerized execution and permission to run on that configuration.

When training the model, you need to select a containerized execution configuration on the Runtime environment panel of the Design tab.

On the Hyperparameters panel, choose to distribute the hyperparameter search and select the number of Kubernetes containers you wish to use.

When you train the model, the Results page during training displays the containers spinning up and shutting back down. It otherwise proceeds and produces output normally.