Encoder Neural Network

An Encoder Neural Network is a neural network that creates an encoding representation (such as an encoding vector).

• Context:
  • It can be trained by an Encoder Neural Network Training System (that implements an Encoder Neural Network Training Algorithm to solve an Encoder Neural Network Training Task).
  • It can range from being
  • It can be a member of an Encoder-Decoder Neural Network.
  • …
• Example(s):
  • an Encoder Recurrent Neural Network, such as: an Encoder GRU-RNN or an Encoder LSTM-RNN;
  • an Encoder Convolutional Neural Network;
  • an Attention Encoder RNN;
  • a Neural Auto-Encoding Network.
  • …
• Counter-Example(s):
  • a Decoder Neural Network.
• See: Neural Machine Translation System, Text Error Correction System, WikiText Error Correction System, Seq2Seq Neural Network, Natural Language Processing System.

---

---

References

2016

• (Xie et al., 2016) ⇒ Ziang Xie, Anand Avati, Naveen Arivazhagan, Dan Jurafsky, and Andrew Y. Ng. (2016). “Neural Language Correction with Character-Based Attention.” In: CoRR, abs/1603.09727.

2014

• (Cho et al., 2014a) ⇒ Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. (2014). “Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation”. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, (EMNLP-2014). arXiv:1406.1078

2013

• https://www.slideshare.net/franciscozamoraceu/2013-icann-traspas
  • QUOTE:

2011

• (Glorot et al., 2011a) ⇒ Xavier Glorot, Antoine Bordes, and Yoshua Bengio. (2011). “Domain Adaptation for Large-scale Sentiment Classification: A Deep Learning Approach.” In: Proceedings of the 28th International Conference on Machine Learning (ICML-11).

---