SATS : Scenario-Anchored Topology-Inspired Structural Scoring
Abstract
AbstractSentence-level structural reasoning, reflected in relational connectivity patterns induced by attention distributions, plays an important role in grammatical acceptability judgment and figurative expression understanding. However, most existing scoring approaches rely primarily on token-level probability signals or sentence-level similarity, which do not explicitly capture structural relationships between tokens. We propose Scenario-Anchored Topology-Inspired Structural Scoring (SATS), a structure-aware comparison method that evaluates coherence between a scenario and multiple candidate interpretations using connectivity patterns derived from attention matrices. Unlike prior topology-inspired approaches that focus on pairwise comparisons, SATS directly supports multi-option reasoning while maintaining low computational cost. Experiments on BLiMP, FLUTE, and Pragmatics show that SATS improves encoder-based model performance in many settings and can approach the accuracy of much larger language models. These results suggest that explicit structural comparison can provide a useful complementary signal for the evaluated language understanding tasks.