Sentence-level Language Model

A Sentence-level Language Model is a Language Model that operates at a sentence level.

• AKA: Phrase-level Language Model.
• Example(s):
  • SentencePiece,
  • …
• Counter-Example(s):
  • Character-level Language Model,
  • Word-level Language Model,
  • Subword-level Language Model.
• See: SentencePiece, Subword Embedding System, Word/Token Embedding Space, OOV Word, Language Model, Word Embedding System, Natural Language Processing System, Natural Language, Semantic Word Similarity, Seq2Seq Neural Network.

---

---

References

2018

• (Kudo & Richardson, 2018) ⇒ Taku Kudo, and John Richardson. (2018). “SentencePiece: A Simple and Language Independent Subword Tokenizer and Detokenizer for Neural Text Processing". In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018) System Demonstrations. DOI:10.18653/v1/d18-2012.

---