Gradient - AshokBhat/ml GitHub Wiki

Description

• Slope of the loss function, that helps point to the direction of the descent

Mathematics

• The vector of partial derivatives with respect to all of the independent variables.
• In machine learning, the gradient is the vector of partial derivatives of the model function.
• The gradient points in the direction of steepest ascent.

Illustration

See also

• Gradient Descent