360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agents
The benchmark puts current LMM agents through city-scale navigation in a photorealistic Akihabara, and they fail well below human performance.
360CityArena is built from 602 360-degree video segments covering 85 streets in Tokyo’s Akihabara district. It includes 175 human-crafted tasks across environment understanding, path reasoning, and spatial reasoning. The strongest tested agent, Gemini 2.5 Flash, scored 17.1% versus 77.3% for humans. The paper frames that gap as evidence that realistic urban navigation remains a hard benchmark for embodied agents. HF Daily Papers' note
360CityArena is built from 602 360-degree video segments covering 85 streets in Tokyo’s Akihabara district. It includes 175 human-crafted tasks across environment understanding, path reasoning, and spatial reasoning. The strongest tested agent, Gemini 2.5 Flash, scored 17.1% versus 77.3% for humans. The paper frames that gap as evidence that realistic urban navigation remains a hard benchmark for embodied agents. HF Daily Papers' note
score 5