SOLID: Infusing Symbolic Logic into LLMs via Dual-Verified Backward Reasoning
Abstract
AbstractLarge Language Models (LLMs) often struggle with rigorous logical reasoning, suffering from hallucinations and inconsistent deduction. Chain-of-Thought (CoT) prompting relies heavily on the frozen model’s inherent capabilities, while neuro-symbolic approaches face a "translation reliability" bottleneck in which semantic parsing errors mislead external solvers. Recent work attempts to infuse symbolic capabilities via fine-tuning, but typically mimics forward reasoning, suffering from search-space explosion and irrelevant intermediate facts that dilute attention. We propose SOLID (Symbolic Oriented Logic Infusion via Dual-verification), a framework that synthesizes high-quality supervision through a Dual-Verification Mechanism: bidirectional consistency checks filter out hallucinated translations. Crucially, instead of forward chaining, we execute validated translations to generate backward reasoning traces—verifying necessary premises from the goal. By fine-tuning on these focused, goal-oriented paths, SOLID infuses the model with the efficient deduction process of a symbolic engine. Experiments on ProntoQA, LogicNLI, and ProofWriter demonstrate state-of-the-art accuracy, significantly outperforming CoT baselines, solver-based methods, and forward-chaining variants. Code and data are available at: https://github.com/ejie22/SOLID.