Skip to content
conftrace_
2026 EMNLP EMNLP 2026

DuoPRAG: Rank-Disentangled and Gated Knowledge-Reasoning Fusion

AbstractWe rethink parametric retrieval-augmented generation with DuoPRAG, which integrates knowledge and reasoning capabilities through rank-disentangled and gated Low-Rank Adaptation (LoRA) composition. Existing parametric RAG methods encode document knowledge into LoRA parameters while leaving reasoning to be supplied through lexical chain-of-thought (CoT) prompting. This introduces three failure modes in outputs and contradicts the prompt-independent inference that parametric RAG aims to achieve. DuoPRAG parameterizes knowledge and reasoning into disentangled LoRA adapters, fused through a learnable mask and rank-specific gates. We achieve state-of-the-art performance on multi-hop QA benchmarks, outperforming the strongest parametric RAG baseline while preserving the parametric inference framework. Our results demonstrate that jointly parameterizing knowledge and reasoning is a natural and effective extension of the parametric RAG paradigm. Our code is available at https://github.com/naknak-choi/DuoPRAG.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

More from EMNLP 2026

All EMNLP 2026 papers →