PRM-as-a-Judge 1.5: A Toolkit for Robot Process Assessment
The toolkit turns robot rollout videos into dense progress curves for judging how manipulation attempts unfold.
It adds metrics for failure-side progress, recovery after setbacks, and execution quality on successful runs. The authors also introduce RoboPulse++ to test the reliability of process reward models. They say the release includes the benchmark, metric implementation, and visualization tools for reproducible evaluation. HF Daily Papers' note
It adds metrics for failure-side progress, recovery after setbacks, and execution quality on successful runs. The authors also introduce RoboPulse++ to test the reliability of process reward models. They say the release includes the benchmark, metric implementation, and visualization tools for reproducible evaluation. HF Daily Papers' note
score 4