Gradient Descent-based Learning Algorithm

A Gradient Descent-based Learning Algorithm is a supervised learning algorithm that is a gradient descent algorithm.

• Counter-Example(s):
  • Convex Optimization-based Learning Algorithm.
• See: Perceptron Algorithm, Gradient Descent-based Learning System.

---

---

References

1998

• (LeCun & al, 1998) ⇒ Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. (1998). "Gradient-based Learning Applied to Document Recognition ." doi:10.1109/5.726791

1990

• Williams, Ronald J., and Jing Peng. "An efficient gradient-based algorithm for on-line training of recurrent network trajectories." Neural computation 2, no. 4 (1990): 490-501.

---