Multi-Lingual Neural Network-based Language Model (NLM)

A Multi-Lingual Neural Network-based Language Model (NLM) is a Multi-Lingual language model that is neural network-based language model.

• Context:
  • …
• Example(s):
  • BLOOM.
  • …
• Counter-Example(s):
  • a Uni-Lingual NLM.
• See: Language Modeling Task, Language Modeling Benchmark.

---

---

References

2022

• https://bigscience.huggingface.co/blog/bloom
  • QUOTE: ... Large language models (LLMs) have made a significant impact on AI research. These powerful, general models can take on a wide variety of new language tasks from a user’s instructions. However, academia, nonprofits and smaller companies' research labs find it difficult to create, study, or even use LLMs as only a few industrial labs with the necessary resources and exclusive rights can fully access them. Today, we release BLOOM, the first multilingual LLM trained in complete transparency, to change this status quo — the result of the largest collaboration of AI researchers ever involved in a single research project. ...

---