Salesforce CodeGen Model

An Salesforce CodeGen Model is an text-to-code model.

• Example(s):
  • CodeGen1.
  • CodeGen2.
  • CodeGen2.5 [1].
  • ...
• Counter-Example(s):
  • GPT-4 Model.
  • Codex Model.
• See: [[]].

---

---

References

2022

• https://blog.salesforceairesearch.com/codegen/
  • QUOTE: Approach. Salesforce AI Research trained CodeGen, a 16-billion parameter auto-regressive language model, on a large corpus of natural and programming languages. Two aspects are of particular interest: (1) sampling executable code by scaling the size of the model and dataset, (2) emergence of conversational capabilities.

2022

• https://github.com/salesforce/CodeGen/tree/main
  • ... CodeGen is an open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

---