Skip to content
conftrace_
2026 EMNLP EMNLP 2026

EVO-RAG: Evolving Retrieval-Augmented Agents for Efficient Multi-Hop Query Optimization

AbstractRetrieval-augmented generation (RAG) grounds large language models (LLMs) in external evidence, yet multi-hop pipelines still suffer from redundant sub-queries, shallow exploration, and premature or delayed stopping. We present EVO-RAG, a phase-aware framework that couples a lightweight two-stage curriculum (Discovery→Refinement) with seven step-level rewards and an in-episode time scheduler. The scheduler decays exploration incentives as evidence accumulates while increasing efficiency and correctness pressure as uncertainty shrinks. Beyond scalar rewards, we train a multi-head preference model and benchmark DPO, PPO, and GRPO under identical rollouts and curricula for a controlled comparison. Evaluated on HotpotQA, 2WikiMultiHopQA, MuSiQue, and Bamboogle with 8B-class backbones, EVO-RAG improves EM/F1 while reducing redundant hops. Ablations show that suppressing query overlap, rewarding controlled backtracking and justified refusal, and time-dynamic weighting are key to the accuracy–efficiency trade-off.

More from EMNLP 2026

All EMNLP 2026 papers →