Adaptive Learning Rate Algorithm (AdaDelta)

From GM-RKB
Jump to navigation Jump to search

An Adaptive Learning Rate Algorithm (AdaDelta) is a Gradient Descent-based Learning Algorithm that uses the exponential decay rate of the first- and second-order moments.



References

2018a

2018c

2018d

2012