Divide by Question, Conquer by Agent: SPLIT-RAG with Question-driven graph partitioning
Abstract
AbstractRetrieval-augmented generation over knowledge graphs (KGs) can improve the factual grounding of large language models, but efficient retrieval remains challenging when the underlying graph is large and multi-hop evidence is distributed across different regions. We present **SPLIT-RAG**, an efficiency-oriented multi-agent KG-RAG framework that organises a KG into reusable, question-aligned partitions using reasoning patterns observed in training questions. At inference time, SPLIT-RAG forms a query-specific retrieval plan, activates only a small set of relevant partition-specialised agents, and aggregates their retrieved evidence before final answer generation. To improve reliability when evidence from different agents is combined, the framework applies compatibility-based filtering over retrieved triples prior to synthesis. Experiments on WebQSP, CWQ, and MetaQA show that SPLIT-RAG achieves strong performance against recent KG+LLM baselines while reducing end-to-end latency under matched budgets. Component ablations and model-tier analyses further show that selective multi-agent retrieval is central to the performance gain, and that lightweight retrieval agents paired with a stronger head agent provide an effective accuracy–latency trade-off.