Megadose The AI curve, compressed.

LynnReal-Hand: Unlocking World Interaction with Hand Control

· ArXiv · AI/CL/LG ·
LynnReal-Hand streams hand-controlled video at 540p and 18.03 FPS on a single H200, with 741ms latency.

The model translates hand movements into generated video of object interactions, using training data drawn from 100,000 real and synthetic interaction clips. The authors combine few-step generation with a compact video decoder to reduce computation. They report better hand-following accuracy and visual quality than existing approaches on HandBench, with optimized peak GPU memory use of 34.89GB for streaming. They plan to release the datasets, model weights, and training and inference code.

ArXiv · AI/CL/LG's note

score 5

Categories: Research