- [[sigmoid function]]
# Idea
One of the most common non-linear [[activation function]] in [[neural networks]].
![[Pasted image 20220119143213.png]]
$\sigma = max(0, x)$
$
\left\{\begin{array}{l}
0, \text { if } x<0 \\
x, \text { if } x>=0
\end{array}\right.
$
# References