Every Answer Has Its Own Path: Agentic Routing for Retrieval-Augmented Table Question Answering
Abstract
AbstractDocuments that users query mix tables with prose, but the QA systems built for them do not: retrieve-and-read pipelines flatten tables, while text-to-SQL pipelines ignore passages. Corporate filings, scientific reports, and Wikipedia articles all sit on this fault line, and a single user question routinely crosses it. We present ATR (AgenticTableRAG), an agentic framework for hybrid table-text question answering. ATR decomposes each question into ordered sub-queries and dispatches each to one of four execution primitives: text reading, cell retrieval, SQL execution, or a hybrid of cell grounding and SQL. When the retrieved evidence does not support the predicted answer, the router is re-invoked with the failed-route history and dispatches a different primitive. Value grounding composed with constrained SQL execution rules out column and value hallucinations by construction. The routing policy is distilled into a lightweight student model that transfers across benchmarks without additional inference-time LLM calls. A single ATR configuration leads on token F1 across three benchmarks without per-dataset tuning.