Neural Encoder-Decoder Network

From GM-RKB
Jump to: navigation, search

An Neural Encoder-Decoder Network is a Deep Neural Network that consists of parallelization of an encoder network and a decoder network.



References

2018a

2018b

2017a

2017b

2016a

2016b

Figure 1: In the encoder-decoder model, the encoder (bottom) generates a representation of the input sequence $\vec{x}$ from which the decoder (top) generates the output sequence $\vec{y}$. The attention-based mechanism (shown here) enables the decoder to “peek" into the input at every decoding step through multiple input representations $a_t$. Illustration from Bahdanau et al. (2014).

2016c

2016d

2015

2014a

2014b