Small Neural Language Model (SLM)
Jump to navigation
Jump to search
A Small Neural Language Model (SLM) is a type of neural language model characterized by its relatively simple architecture compared to deep neural networks.
- Context:
- It can (typically) consist of fewer layers or parameters compared to deep neural networks.
- It can (often) use a simple Recurrent Neural Network (RNN) or a Feedforward Neural Network (FNN).
- It can be fast to train and have lower computational requirements.
- It can achieve baseline performance.
- ...
- See: Large Neural Language Model.