Holo4D: Holistic 4D Reconstruction as Geometric Control for Video Diffusion
Holo4D can use different 4D reconstruction models without retraining its video generator.
The framework reshoots a single-camera video along a requested camera path. It projects reconstructed 3D trajectories into the new views, using their geometry and source appearance to guide a pretrained video diffusion model. Reconstructed observations anchor the output, while the generative model fills regions unseen in the source. The authors report that trajectory-based guidance helps camera control and novel-view synthesis.
HF Daily Papers' note
The framework reshoots a single-camera video along a requested camera path. It projects reconstructed 3D trajectories into the new views, using their geometry and source appearance to guide a pretrained video diffusion model. Reconstructed observations anchor the output, while the generative model fills regions unseen in the source. The authors report that trajectory-based guidance helps camera control and novel-view synthesis.
HF Daily Papers' note
score 5