TransferFunctions - davidrmiller/neural2d GitHub Wiki
Here are the transfer functions that are available for use in neural2d. If not specified, all neurons will use tanh. The transfer function can be specified per-layer with the tf parameter in the topology config file (see the README.md and ParameterList for more information).
tanh
logistic
linear
ramp
gaussian
ReLU
This is a softplus approximation of a ReLU.