Large Language Model-Based Automated Program Repair Method

A Large Language Model-Based Automated Program Repair Method is an automated program repair method that utilizes large language models to generate program patches.

• AKA: LLM-Based Program Repair, Neural Language Model Repair Method, Transformer-Based Code Repair Method.
• Context:
  • It can typically leverage Pre-Trained Language Models for code understanding.
  • It can typically generate Code Patches through neural generation.
  • It can often incorporate Program Context for accurate repair.
  • It can often utilize Fine-Tuning on bug-fix datasets.
  • ...
  • It can range from being a Zero-Shot Automated Program Repair Method to being a Few-Shot Automated Program Repair Method, depending on its example requirement.
  • It can range from being a Single-Model Automated Program Repair Method to being a Ensemble Automated Program Repair Method, depending on its model architecture.
  • It can range from being a Pre-Trained Automated Program Repair Method to being a Fine-Tuned Automated Program Repair Method, depending on its training approach.
  • It can range from being a Context-Limited Automated Program Repair Method to being a Full-Repository Automated Program Repair Method, depending on its context window size.
  • ...
  • It can be implemented using Transformer-Based Large Language Models.
  • It can integrate with Retrieval-Augmented Generation Frameworks.
  • It can utilize Code Embeddings for semantic understanding.
  • ...
• Example(s):
  • GPT-Based Automated Program Repair Methods using decoder-only transformers.
  • CodeT5 Automated Program Repair Method using encoder-decoder architecture.
  • Retrieval-Augmented Automated Program Repair Methods combining LLMs with code retrieval.
  • CodeBERT Automated Program Repair Method using bidirectional transformers.
  • InCoder Automated Program Repair Method for infilling-based repair.
  • AlphaCode Automated Program Repair Method with competitive programming capability.
  • StarCoder Automated Program Repair Method trained on permissive license codes.
  • ...
• Counter-Example(s):
  • Rule-Based Repair Method, which uses predefined patterns.
  • Genetic Programming Repair Method, which uses evolutionary search.
  • Constraint-Based Repair Method, which uses formal methods.
• See: Large Language Model, Automated Program Repair Method, Neural Language Model, Software Maintenance Method.

---