L3G-World: Real-Time Infinite World Generation with Latent 3D Gaussian Memory
The authors report world generation at 9 FPS, with memory that grows as new areas are explored rather than as video runs longer.
L3G-World adds 3D Gaussians for newly observed regions and refines those already stored. Each Gaussian holds a latent feature that feeds directly into the video generator, avoiding an RGB rendering and re-encoding step. Against the most efficient prior 3D-memory baseline for each metric, the paper reports up to 38.6× fewer primitives, 3.2× faster memory updates and 359× faster memory rendering. The authors also report state-of-the-art generation quality and spatial consistency over long exploration sequences.
HF Daily Papers' note
L3G-World adds 3D Gaussians for newly observed regions and refines those already stored. Each Gaussian holds a latent feature that feeds directly into the video generator, avoiding an RGB rendering and re-encoding step. Against the most efficient prior 3D-memory baseline for each metric, the paper reports up to 38.6× fewer primitives, 3.2× faster memory updates and 359× faster memory rendering. The authors also report state-of-the-art generation quality and spatial consistency over long exploration sequences.
HF Daily Papers' note
score 5