Encoder-Decoder Neural Network

From GM-RKB
Jump to navigation Jump to search

An Encoder-Decoder Neural Network is a modular neural network that consists of an encoder network and a decoder network.



References

2018a

2018b

2017a

2017b

2016a

2016b

Figure 1: In the encoder-decoder model, the encoder (bottom) generates a representation of the input sequence $\vec{x}$ from which the decoder (top) generates the output sequence $\vec{y}$. The attention-based mechanism (shown here) enables the decoder to “peek" into the input at every decoding step through multiple input representations $a_t$. Illustration from Bahdanau et al. (2014).

2016c

2016d

2015

2014a

2014b