Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Scoped Semantic Invariance as a Foundation for LLM Reliability

AbstractLLMs often answer semantically equivalent queries inconsistently, even when the underlying facts are known. We formalize consistency as semantic invariance over equivalence classes of queries and show that invariance under arbitrary meaning-preserving transformations is undecidable in general. This motivates scoped semantic invariance, where model behavior is evaluated relative to bounded semantic domains.We operationalize this framework using knowledge graphs (KGs), which act as explicit semantic control structures defining local semantics and grounding contexts. Across the MITRE D3FEND ontology and eight Wikidata-derived domains, we show that inconsistencies are structured rather than random, concentrating in localized hotspot subgraphs organized around recurring TREE, STAR, and CYCLE patterns that recur across models and domains.We further show that selective graph grounding improves consistency with the KG specification and cross-model agreement, while indiscriminate grounding introduces regressions. A layered grounding strategy achieves the strongest monotonicity profile, preserving KG-consistent knowledge while reducing inconsistency. Finally, we show that hotspot structures discovered from simple consistency probes transfer to more realistic compositional reasoning tasks, positioning them as a practical reliability layer for predicting and targeting failures rather than a canonical decomposition.

More from EMNLP 2026

All EMNLP 2026 papers →