PaLM-E Model

From GM-RKB
Jump to navigation Jump to search

A PaLM-E Model is a large neural language model.



References

2023

  • https://ai.googleblog.com/2023/03/palm-e-embodied-multimodal-language.html
    • QUOTE: Today we introduce PaLM-E, a new generalist robotics model that overcomes these issues by transferring knowledge from varied visual and language domains to a robotics system. We began with PaLM, a powerful large language model, and “embodied” it (the “E” in PaLM-E), by complementing it with sensor data from the robotic agent. This is the key difference from prior efforts to bring large language models to robotics — rather than relying on only textual input, with PaLM-E we train the language model to directly ingest raw streams of robot sensor data. The resulting model not only enables highly effective robot learning, but is also a state-of-the-art general-purpose visual-language model, while maintaining excellent language-only task capabilities.