Adaptive Piecewise Linear Activation Function

From GM-RKB
Jump to navigation Jump to search

An Adaptive Piecewise Linear (APL) Activation Function is a neuron activation function that is based on the piecewise linear function: [math]\displaystyle{ f(x) = \max(0,x) + \sum_{s=1}^{S}a_i^s \max(0, -x + b_i^s) }[/math] [math]\displaystyle{ }[/math].



References

2017

2014