Hyperparameter - AshokBhat/ml GitHub Wiki

Description

• Knobs that ML practitioner has to tweak during successive runs of training a model
• Unlike parameters, hyperparameters are not automatically learned
• Example - learning rate

Common hyperparameters

• [Learning rate]] ](/AshokBhat/ml/wiki/[Learning-rate-decay) | [Epoch]]
• Number of [Layer]]s ](/AshokBhat/ml/wiki/[[Activation-function)s of layers

Difference between parameter and hyperparameter

Area	Hyperparameter	Parameter
Who decides?	Trainer	Training process
Example	Number of layers Learning rate Activation functions	Weight Bias

FAQ

• What is the difference between a parameter and hyperparameter?
  • Parameters are automatically learned during the training process.
  • Hyperparameters have to be decided by the trainer

See also

• Parameter
• [Learning rate]] ](/AshokBhat/ml/wiki/[[Learning-rate-decay)
• [Epoch]] ](/AshokBhat/ml/wiki/[[Batch-size)
• [Layer]] ](/AshokBhat/ml/wiki/[[Activation-function)