What changed
Google Deepmind has introduced Genie 4, an interactive world model that calculates environments frame by frame in real time and, for the first time, directly generates matching background audio and character dialogue. Gemini models steer events in the background, planning multistep tasks and continuously adapting the simulated world to user text prompts and changing conditions. Genie 4 is still an experimental research model with limitations in longer sessions and complex physics. Access is limited to select testers for now and will later expand to Google AI Ultra rs.
What this means in practice
Genie 4 is supposed to simulate interactive worlds in real time, including sound and talking characters. Gemini models plan in the background what happens next in the simulation. Users move through the scene with the keyboard and steer events with text prompts. According to Deepmind, Genie 4 is the company's first real-time world model that generates sound directly. The company says each world has its own background audio, such as wind in the trees. Genie 4 also handles dialogue, with characters that are supposed to talk to each other and react in real time to user input or events.
Limitations and availability
Deepmind calls Genie 4 an early, experimental model. According to the company, the world stays consistent over short sessions, but visual details can shift and objects don't always persist in longer simulations or after several complex prompt changes. Deepmind says it's still researching complex physical interactions, accurate real-time sound, and readable text. For now, Genie 4 is only available to select testers as a research preview. It's set to reach Google AI Ultra rs in the Project Genie web app soon, along with partners who have early access to the Gemini API and Google AI Studio.
