GPT (Generative Pre-trained Transformer) Architecture

A GPT (Generative Pre-trained Transformer) Architecture is a transformer-based decoder-only autoregressive sequential data model architecture.

• Context:
  • It can (typically) be referenced by a GPT Model (such as GPT-4).
  • …
• Example(s):
  • as defined in ...
  • …
• Counter-Example(s):
  • BERT Architecture.
• See: LLM Architecture.

---

---