Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory
The paper’s core claim is minute-long, real-time interactive world generation with stronger scene recall and camera control.
Matrix-Game 3.5 builds on Matrix-Game 3.0 with a geometry-aware memory system using patch memory and tiled-PRoPE, without adding learnable parameters. The authors say it separates static scene geometry from dynamic subjects to preserve both layout and identity over long horizons. A two-stage distillation process turns a bidirectional diffusion model into a few-step causal generator for real-time use. Experiments span Unreal simulation environments, open-world games, and internet videos.
HF Daily Papers' note
Matrix-Game 3.5 builds on Matrix-Game 3.0 with a geometry-aware memory system using patch memory and tiled-PRoPE, without adding learnable parameters. The authors say it separates static scene geometry from dynamic subjects to preserve both layout and identity over long horizons. A two-stage distillation process turns a bidirectional diffusion model into a few-step causal generator for real-time use. Experiments span Unreal simulation environments, open-world games, and internet videos.
HF Daily Papers' note
score 6