Skip to content
conftrace_
2026 ICML ICML 2026

DV-World: Benchmarking Data Visualization Agents in Real-World Scenarios

Real-world data visualization (DV) requires native environmental grounding, cross-platform evolution, and proactive intent alignment, yet existing benchmarks are often limited to code sandboxes, creation-only tasks, and fully specified intents. We introduce DV-World, a 260-task benchmark for evaluating DV agents across professional visualization lifecycles. DV-World covers three domains: DV-Sheet for native spreadsheet chart/dashboard creation and diagnostic repair; DV-Evolution for adapting reference visual artifacts to new data across programming paradigms; and DV-Interact for proactive intent alignment with a user simulator under ambiguous requirements. Its hybrid evaluation combines Table-value Alignment for numerical precision with rubric-based MLLM-as-a-Judge for semantic-visual assessment. Experiments show that state-of-the-art models achieve below 50% overall performance, exposing major gaps in real-world DV capabilities. DV-World provides a realistic testbed for developing DV agents suited to enterprise workflows. Data and code are available at dv-world-project.github.io.

More from ICML 2026

All ICML 2026 papers →