Adaptive Piecewise Linear Activation Function

From GM-RKB
Jump to: navigation, search

An Adaptive Piecewise Linear (APL) Activation Function is a neuron activation function that is based on the piecewise linear function: [math]f(x) = \max(0,x) + \sum_{s=1}^{S}a_i^s \max(0, -x + b_i^s)[/math] [math][/math].



References

2017

2014