Skip to content
View original post on X: Rohan Paul
Published
62/100

Google DeepMind's Genie 4 adds real-time native audio and in-simulation editing

AIGoogle DeepMind announces Genie 4, a real-time world model that generates ambient sound, music and live dialogue from characters who react to users and in-world events. Users can rewrite a running simulation by typing, changing weather, moving the camera or adding people, while Gemini fits each edit to the scene.
Rohan PaulVerified on X
@rohanpaul_ai
View on X

Genie 4 is Google DeepMind’s first real-time world model with native audio, generating ambient sound, music and live dialogue from characters who react to users and in-world events.

Users can rewrite a running simulation by typing, changing weather, moving the camera or adding people, while Gemini fits each edit to the scene and keeps it coherent.

Gemini 3.8 Flash acts as an in-loop director, splitting goals into steps and checking incoming frames, and Gemini 4 Argon used that loop to simulate Apptronik’s Apollo humanoid playing checkers.

access starts with trusted testers before Google AI Ultra subscribers and early Gemini API partners. https://x.com/sundarpichai/status/2115115252690145519/video/1

Source details

Rohan Paul · x.comPublished · added here

Original title: > Genie 4 is Google DeepMind’s first real-time world model with native audio, generating ambient sound, music and live dialogue from char...