Skip to content
conftrace_
2026 AACL AACL 2026

More Modalities, More Problems: When Multimodal Agentic Debate Hurts Time-Series Reasoning

AbstractMulti-agent debate is often motivated by the premise that multiple agents, modalities, and rounds of deliberation improve reasoning by combining complementary evidence and correcting individual errors. We test this premise in multimodal time-series analysis using MAD-TS, a prompting-based framework with modality-specific agents, cross-modal judging, and synthesis. Contrary to expectation, MAD-TS does not reliably outperform simpler baselines. Across 20 tasks in finance, weather, healthcare, and science, it is uniquely best on 2 of 23 outcomes and significantly beats a strong single-agent multimodal baseline on only one task, while requiring about 22× more tokens and 12× more wall-clock time. Adding modalities, increasing debate depth, or changing judge rounds can help some tasks but harm others. Trace analysis attributes 85% of errors to all three judges agreeing on the same wrong answer, a shared upstream bias that limits same-backbone multimodal debate as a general-purpose approach.

More from AACL 2026

All AACL 2026 papers →