Base Language Model (BLM)

A Base Language Model (BLM) is a pre-trained language model that is trained on the predict the next word task.

• Context:
  • It can range from being a Small BLM to being a Large BLM (like GPT-1).
  • ...
• See: Finetuned Language Model.

---

---