Large Language Model (LLM) Prompt

An Large Language Model (LLM) Prompt is an AI prompt that ...

• Context:
  • It can range from being a Human-Designed LLM Prompt to being a AI-designed LLM Prompt.
  • ...
• See: LLM Prompting, LLM Prompt Engineering, LLM Prompt Optimization.

---

---

References

2023

• (Yang, Wang et al., 2023) ⇒ Chengrun Yang, Xuezhi Wang, Yifeng Lu, Hanxiao Liu, Quoc V. Le, Denny Zhou, and Xinyun Chen. (2023). “Large Language Models As Optimizers.” doi:10.48550/arXiv.2309.03409
  • QUOTE: ...In each optimization step, the LLM generates new solutions from the prompt that contains previously generated solutions with their values, then the new solutions are evaluated and added to the prompt for the next optimization step. We first showcase OPRO on linear regression and traveling salesman problems, then move on to prompt optimization where the goal is to find instructions that maximize the task accuracy. With a variety of LLMs, we demonstrate that the best prompts optimized by OPRO outperform human-designed prompts by up to 8% on GSM8K, and by up to 50% on Big-Bench Hard tasks.

---