What changed
Google DeepMind announced the release of Genie 4, its latest world model, as a research preview. The model generates the most photorealistic and interactive worlds yet, allowing users to type prompts mid-simulation to change the scene. It also generates real-time audio that matches the simulated world, including music, ambient noises, and interactive dialogue. Genie 4 allows for free-form edits, such as changing the weather or camera angle in real time or adding new people or objects. It can maintain a consistent scene for up to two minutes, double its predecessor’s limit, and offers better physics and more humanlike characters. Gemini, Google’s AI model, is more closely integrated with Genie 4, acting as the director that plans steps and checks frames while Genie creates the visuals.
What this means in practice
The release of Genie 4 comes a couple of months after AI video startup Runway released its second world model, GWM Worlds 2. The model is available now as a research preview for trusted testers. In the coming weeks, it will roll out to Google AI Ultra rs in Project Genie, Google’s AI tool for generating interactive worlds from text or image prompts, and early access partners of the Gemini API and Google AI Studio. The model’s real-time audio and scene-editing capabilities could have applications in gaming, interactive learning, and robotics. One speculative example of interactive learning would be entering a painting of a historical scene and chatting to the painting’s subjects about the event portrayed. Google also offers Veo, its AI video-generation model that makes high-definition clips with built-in synchronized audio from text, image, or video prompts.
Limitations and availability
Genie 4 is available now as a research preview for trusted testers. The team acknowledged that it still has gaps: Details and objects can drift the longer a simulation runs, and they still haven’t quite figured out how to ensure the audio will be accurate and any in-world text will be legible. The model is not yet clear on what the end-to-end product experience will be. The release of Genie 4 is part of Google’s effort to stay ahead in the crowded field of world models, with the industry beginning to consolidate as Fei-Fei Li’s World Labs is being acquired by AMD, Amazon is in talks to buy Decart, and Rivian just acquired Third Dimension to bring simulation capabilities in-house for self-driving testing.
