OpenAI LLM Fine-Tuning API

From GM-RKB
(Redirected from OpenAI Fine-Tuning API)
Jump to navigation Jump to search

An OpenAI LLM Fine-Tuning API is a LLM fine-tuning API that supports OpenAI's LLM fine-tuning system.



References

2024

2023

  • https://platform.openai.com/docs/guides/fine-tuning
    • QUOTE: Fine-tuning lets you get more out of the models available through the API by providing:
      • Higher quality results than prompting
      • Ability to train on more examples than can fit in a prompt
      • Token savings due to shorter prompts
      • Lower latency requests
    • OpenAI's text generation models have been pre-trained on a vast amount of text. To use the models effectively, we include instructions and sometimes several examples in a prompt. Using demonstrations to show how to perform a task is often called "few-shot learning."
    • Fine-tuning improves on few-shot learning by training on many more examples than can fit in the prompt, letting you achieve better results on a wide number of tasks. Once a model has been fine-tuned, you won't need to provide as many examples in the prompt. This saves costs and enables lower-latency requests.
    • At a high level, fine-tuning involves the following steps:
      • Prepare and upload training data
      • Train a new fine-tuned model
      • Evaluate results and go back to step 1 if needed
      • Use your fine-tuned model