BayesianParameterSampling Class
Defines Bayesian sampling over a hyperparameter search space.
Bayesian sampling tries to intelligently pick the next sample of hyperparameters, based on how the previous samples performed, such that the new sample improves the reported primary metric.
Initialize BayesianParameterSampling.
- Inheritance
-
azureml.train.hyperdrive.sampling.HyperParameterSamplingBayesianParameterSampling
Constructor
BayesianParameterSampling(parameter_space, properties=None)
Parameters
Name | Description |
---|---|
parameter_space
Required
|
|
parameter_space
Required
|
A dictionary containing each parameter and its distribution. The dictionary key is the name of the parameter. Note that only choice, quniform, and uniform are supported for Bayesian optimization. |
properties
|
Default value: None
|
Remarks
Note that when using Bayesian sampling, the number of concurrent runs has an impact on the effectiveness of the tuning process. Typically, a smaller number of concurrent runs leads to better sampling convergence. That is because some runs start without fully benefiting from runs that are still running.
Note
Bayesian sampling does not support early termination policies. When using Bayesian parameter sampling, use NoTerminationPolicy, set early termination policy to None, or leave off the early_termination_policy parameter.
For more information about using BayesianParameter sampling, see the tutorial Tune hyperparameters for your model.
Attributes
SAMPLING_NAME
SAMPLING_NAME = 'BayesianOptimization'