Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Groundedness Is Not Truth: Evidence-Chain Forensics for Retrieval-Augmented Generation

AbstractA single faithfulness score can hide failures that require different repairs: a RAG answer may be grounded in text whose source is stale, incomplete, contradicted, low-authority, or insufficient. We introduce ContextTrace, a deterministic, local-first SDK and CLI for evidence-chain forensics that separates claim support, citation state, source condition, abstention need, root cause, repair, and regression prevention. We also introduce Groundedness-Truth-Gap, a suite for controlled conformance, while frozen RAGTruth and stress tests serve as failure-safety controls. ContextTrace’s central contribution is an inspectable evidence-chain contract. On a fresh 84-case public-document evaluation, it catches 76 of 77 failure-bearing cases and preserves all seven clean cases (balanced accuracy 0.994; MCC 0.929), the same binary confusion counts as a frozen GPT-4.1-mini judge, while producing typed diagnostic records without additional model calls. The clean-case sample is small, and fine-grained label, root, and unverifiable attribution remains limited. Post-review counterfactuals further show strong dependence on source metadata and temporal cues. We release a blinded 50-case annotation packet and scorer; independent adjudication remains pending. Our claim is reproducible fail-closed diagnosis, not truth verification or broad evaluator superiority.

More from EMNLP 2026

All EMNLP 2026 papers →