FVScore: Specification-Driven Neuro-Symbolic Video Evaluation
FVScore pinpoints violations in generated videos and reports when they occur, with supporting evidence.
The framework checks both explicit prompt requirements and unstated physical, temporal and cross-modal constraints. Specialized perceptual tools ground those checks, while temporal logic tracks whether requirements hold over time. A calibration step retains only violations judged perceptually significant. The authors report stronger agreement with human judgments than holistic and agent-based evaluators across public and complex multi-event benchmarks.
ArXiv · AI/CL/LG's note
The framework checks both explicit prompt requirements and unstated physical, temporal and cross-modal constraints. Specialized perceptual tools ground those checks, while temporal logic tracks whether requirements hold over time. A calibration step retains only violations judged perceptually significant. The authors report stronger agreement with human judgments than holistic and agent-based evaluators across public and complex multi-event benchmarks.
ArXiv · AI/CL/LG's note
score 5