Entropy-Minimization Algorithm

An Entropy-Minimization Algorithm is an optimization algorithm that minimizes an entropy function.

• Context:
  • It can be applied by an Entropy-Minimization System (that solves an entropy-minimization task).
• See: EM Algorithm.

---

---

References

2005

• (Grandvalet & Bengio, 2004) ⇒ Yves Grandvalet, and Yoshua Bengio. (2004). "Semi-supervised Learning by Entropy Minimization." In: Advances in neural information processing systems, pp. 529-536.

2002

• (Erdogmus & Principe, 2002) ⇒ Deniz Erdogmus, and Jose C. Principe. (2002). "An Error-entropy Minimization Algorithm for Supervised Training of Nonlinear Adaptive Systems." Signal Processing, IEEE Transactions on 50, no. 7

---