Bidirectional LSTM (BiLSTM) Training Algorithm

A Bidirectional LSTM (BiLSTM) Training Algorithm is an LSTM training algorithm implemented within a BiRNN algorithm.

• Context:
  • It can be trained by a BiLSTM Training System (to solve a BiLSTM training task that fits a bidirectional LSTM network).
• Example(s):
  • …
• Counter-Example(s):
  • a Bidirectional GRU (BiGRU) Training Algorithm.
• See: BiLSTM/CRF.

---

---

References

2005

• (Graves & Schmidhuber, 2005) ⇒ Alex Graves, and Jürgen Schmidhuber. (2005). “Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures.” In: Neural Networks Journal, 18(5-6). doi:10.1016/j.neunet.2005.06.042

1997

• (Schuster & Paliwal, 1997) ⇒ Mike Schuster, and Kuldip K. Paliwal. (1997). “Bidirectional Recurrent Neural Networks.” In: IEEE Transactions on Signal Processing Journal, 45(11). doi:10.1109/78.650093
  • QUOTE: In the first part of this paper, a regular recurrent neural network (RNN) is extended to a bidirectional recurrent neural network (BRNN). The BRNN can be trained without the limitation of using input information just up to a preset future frame. …

---