Learn++ Algorithm

A Learn++ Algorithm is a Incremental Learning Algorithm that is used for incremental training of Supervised Neural Networks.

• AKA: Polikar Learning Algorithm.
• Context:
  • It was first developed by Polikar (2001).
  • …
• Example(s):
  • the algorithm included in Polikar (2001).
  • …
• Counter-Example(s):
  • a Fuzzy ARTMAP,
  • a TopoART,
  • an Incremental SVM.
• See: Artificial Neural Network, Incremental Learning System, Machine Learning System, Classification System, Cumulative Learning System.

---

---

References

2001

• (Polikar, 2001) ⇒ Polikar, R., Upda, L., Upda, S. S., & Honavar, V. (2001). "Learn++: An incremental learning algorithm for supervised neural networks". IEEE transactions on systems, man, and cybernetics, part C (applications and reviews), 31(4), 497-508 doi:10.1109/5326.983933.
  • ABSTRACT: We introduce Learn++, an algorithm for incremental training of neural network (NN) pattern classifiers. The proposed algorithm enables supervised NN paradigms, such as the multilayer perceptron (MLP), to accommodate new data, including examples that correspond to previously unseen classes. Furthermore, the algorithm does not require access to previously used data during subsequent incremental learning sessions, yet at the same time, it does not forget previously acquired knowledge. Learn++ utilizes ensemble of classifiers by generating multiple hypotheses using training data sampled according to carefully tailored distributions. The outputs of the resulting classifiers are combined using a weighted majority voting procedure. We present simulation results on several benchmark datasets as well as a real-world classification task. Initial results indicate that the proposed algorithm works rather well in practice. A theoretical upper bound on the error of the classifiers constructed by Learn++ is also provided.

---