Charts as Epistemic Actions for Experience-Driven Agentic Data Analysis
Giving data agents plotting tools did not make them use charts consistently, even when they could read them effectively.
Across 200 controlled tasks, charts performed better on temporal, pattern and anomaly reasoning, while text led on precise reading and conditional verification. The authors then developed a method that distils experience about analytical operations and when to use text, charts or both. Only experience that improves held-out performance is retained. On three held-out benchmarks with four LLM backbones, the method improved analytical accuracy and visual evidence quality over matched baselines without changing model parameters.
ArXiv · AI/CL/LG's note
Across 200 controlled tasks, charts performed better on temporal, pattern and anomaly reasoning, while text led on precise reading and conditional verification. The authors then developed a method that distils experience about analytical operations and when to use text, charts or both. Only experience that improves held-out performance is retained. On three held-out benchmarks with four LLM backbones, the method improved analytical accuracy and visual evidence quality over matched baselines without changing model parameters.
ArXiv · AI/CL/LG's note
score 4