activation function - AshokBhat/ml GitHub Wiki

Description

Non-linear output function
output = f(input x weight + bias)
Significance: Introduces non-linearity into the network, which allows it to learn more complex patterns in the data.

Example activation functions

FAQ

Is activation function non-linear?
- Yes, they are non-linear functions
What are common activation functions?
- Sigmoid, ReLU and Softmax

See also

Neuron | Neural network
Activation function : ReLU | Softmax | Sigmoid | Tanh

⚠️ GitHub.com Fallback ⚠️