Gemini 1.5 LLM

A Gemini 1.5 LLM is a Gemini LLM.

• Context:
  • It can (typically) incorporate a Mixture-of-Experts (MoE) approach.
  • It can (typically) feature an experimental 1 million Token Context Window.
  • It can (often) enable the direct upload of large files into Google AI Studio.
  • It can (often) support the analysis of entire codebases.
  • ...
• Example(s):
  • Gemini 1.5 LLM Pro, such as: models/gemini-1.5-pro-latest.
  • Gemini 1.5 LLM Flash.
  • ...
• Counter-Example(s):
  • Gemini 1.0 LLM, such as Gemini 1 Ultra.
  • GPT-4, Claude 3.
• See: Mixture-of-Experts (MoE).

---

---

References

2024

• https://ai.google.dev/models/gemini

 Model last updated 	February 2024
 Model code 	models/gemini-1.5-pro-latest
 Supported generation methods 	generateContent
 Input token limit 	1048576
 Output token limit 	8192

2024

• (Gemini Team, 2024a) => Google Gemini Team. (2024). “Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context." Google Whitepaper
  • NOTES:
    • The paper introduces the next-generation Gemini 1.5 model, utilizing a new Mixture-of-Experts (MoE) approach for improved efficiency.
    • The paper offers developers a Private Preview of Gemini 1.5 Pro, optimized for scaling across a wide range of tasks.
    • The paper features an experimental 1 million token context window, significantly expanding its processing capability.
    • The paper enables the direct upload of large PDFs, code repositories, or lengthy videos as prompts in Google AI Studio.
    • The paper allows developers to upload multiple files and ask questions, leveraging the larger context window for more relevant outputs.
    • The paper facilitates deep analysis of entire codebases, enhancing developers' productivity and understanding of complex code relationships.
    • The paper can reason across up to 1 hour of video, breaking down thousands of frames for sophisticated reasoning tasks.
    • The paper introduces new ways for developers to build with Gemini models, including easy tuning and new developer surfaces, alongside lower pricing for Gemini 1.0 Pro.

---