Counterfactual Sensitivity Regularization for Trace-Sensitive Reasoning in Large Language Models
Abstract
AbstractLarge language models can produce correct final answers with reasoning traces that are incomplete, inconsistent, or weakly coupled to the answer. We study whether training can increase this coupling in structured reasoning domains. We introduce Counterfactual Sensitivity Regularization (CSR), a training objective that creates verifier-approved counterfactual edits to reasoning traces, such as changing an arithmetic operator or a logical relation, and penalizes models when the answer distribution remains unchanged after an edit that should change the computation. We evaluate this behavior with Counterfactual Outcome Sensitivity (COS), the fraction of originally correct examples on which a validity-breaking trace edit changes the final answer. Because COS is aligned with the CSR objective by construction, we report it jointly with counterfactual target accuracy, target coverage, and null-edit preservation, and alongside evidence collected outside the training loop: natural-unfaithfulness audits, external formal verification, input contrast sets, and trace-dependence probes. Across arithmetic, formal logic, multi-hop question answering, and biomedical QA, CSR substantially improves edit sensitivity while incurring small accuracy trade-offs. The gains are largest in domains where the edited operators can be identified and verified reliably; performance degrades as verifier precision falls. These results support CSR as a practical regularizer for trace-sensitive reasoning, not as a complete solution to explanation faithfulness.