Activation function - AshokBhat/ml GitHub Wiki

Description

• Non-linear output function
• output = f(input x weight + bias)
• Significance: Introduces non-linearity into the network, which allows it to learn more complex patterns in the data.

Example activation functions

FAQ

• Is activation function non-linear?
  • Yes, they are non-linear functions
• What are common activation functions?
  • Sigmoid, ReLU and Softmax

See also

• [Neuron]] ](/AshokBhat/ml/wiki/[[Neural-network)
• [Activation function]] : [[ReLU]] ](/AshokBhat/ml/wiki/[Softmax) | [Sigmoid]]