English as a Programming Language: Difference between revisions
Jump to navigation
Jump to search
m (Text replacement - ">" " to ">” ") |
m (Text replacement - " "<" to " “<") |
||
Line 8: | Line 8: | ||
=== 2023 === | === 2023 === | ||
* ([[Karpathy, 2023]]) => [[Andrej Karpathy]]. | * ([[Karpathy, 2023]]) => [[Andrej Karpathy]]. “<i>The hottest new [[programming language is English]]</i>” https://x.com/karpathy/status/1617979122625712128 | ||
** This tweet went wide, thought I'd post some of the recent supporting articles that inspired it. | ** This tweet went wide, thought I'd post some of the recent supporting articles that inspired it. | ||
*** 1/ GPT-3 paper showed that [[LLM]]s perform [[in-context learning]], and can be "programmed" inside the prompt with input:output examples to perform diverse tasks https://arxiv.org/abs/2005.14165 | *** 1/ GPT-3 paper showed that [[LLM]]s perform [[in-context learning]], and can be "programmed" inside the prompt with input:output examples to perform diverse tasks https://arxiv.org/abs/2005.14165 |
Latest revision as of 04:26, 8 May 2024
An English as a Programming Language is a natural language programming language that ...
- See: Programming Language.
References
2023
- (Karpathy, 2023) => Andrej Karpathy. “The hottest new programming language is English” https://x.com/karpathy/status/1617979122625712128
- This tweet went wide, thought I'd post some of the recent supporting articles that inspired it.
- 1/ GPT-3 paper showed that LLMs perform in-context learning, and can be "programmed" inside the prompt with input:output examples to perform diverse tasks https://arxiv.org/abs/2005.14165
- 2/ These two [1] https://arxiv.org/abs/2205.11916 , [2] https://arxiv.org/abs/2211.01910 are good examples that the prompt can further program the "solution strategy", and with a good enough design of it, a lot more complex multi-step reasoning tasks become possible.
- 3/ These two articles/papers:
- bit more technical but TLDR good prompts include the desired/aspiring performance. GPTs don't "want" to succeed. They want to imitate. You want to succeed, and you have to ask for it.
- This tweet went wide, thought I'd post some of the recent supporting articles that inspired it.