Noisy Rectified Linear Activation Function

From GM-RKB
(Redirected from Noisy ReLU)
Jump to navigation Jump to search

A Noisy Rectified Linear Activation Function is a Rectified-based Activation Function that adds an Gaussian Noise, i.e. [math]\displaystyle{ f(x) = \max(0, x + Y) }[/math] with [math]\displaystyle{ Y \sim \mathcal{N}(0, \sigma(x)) }[/math].



References

2018

2016