Vanishing gradient problem - AshokBhat/ml GitHub Wiki

About

• A problem when the gradient is vanishingly small, effectively preventing the weight from changing its value.
• In the worst case, this may completely stop the neural network from further training

FAQ

• What is vanishing gradient problem?
• How can it be solved?

See also

• Regularization
• Exploding Gradient Problem