Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data
Ego2Robot turns first-person human manipulation videos into robot-format training data at unusually large scale.
The paper describes a pipeline for action retargeting, robot-arm visual synthesis, and quality curation. It reports 18,561 hours of generated robot training data across 15 robot morphologies, from curated datasets and in-the-wild videos. In tests, joint pretraining on the synthesized data and robot data improved out-of-distribution generalization, including on real-robot deployment. HF Daily Papers' note
The paper describes a pipeline for action retargeting, robot-arm visual synthesis, and quality curation. It reports 18,561 hours of generated robot training data across 15 robot morphologies, from curated datasets and in-the-wild videos. In tests, joint pretraining on the synthesized data and robot data improved out-of-distribution generalization, including on real-robot deployment. HF Daily Papers' note
score 6