Iterative Natural Logic Verification for Multi-hop Question Answering
Abstract
AbstractMulti-hop question answering requires composing multiple pieces of evidence to derive the correct answer, making it particularly vulnerable to hallucinated intermediate reasoning steps. A common failure mode arises when neural generators produce intermediate sentences that are fluent but logically inconsistent with the underlying facts, which can subsequently mislead downstream reasoning. In this paper, we propose ITERLOGIC, an iterative natural logic verification framework for multi-hop question answering, which explicitly integrates symbolic verification into the generation process. Specifically, a neural generator composes candidate intermediate sentences from retrieved facts, while a natural logic verifier evaluates their logical consistency with the source evidence. Low-scoring candidates are iteratively rejected and regenerated, allowing the system to progressively eliminate hallucinated compositions. This lightweight interaction upgrades natural logic from a passive scoring component to an active verification signal that guides intermediate sentence generation. Experiments on QASC, WorldTree, and WikiHop demonstrate that ITERLOGIC improves answer accuracy, highlighting the effectiveness of iterative verification for reliable multi-hop reasoning.