Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Not All Tokens Are Equal: Syntax-Pattern Weighted Likelihood Difference Joint Detection for Neural-Training-Free AI-Generated Text Detection

AbstractExisting neural-training-free AI-Generated Text (AIGT) detectors usually aggregate token-level probability signals with uniform weights. However, this ignores an important linguistic regularity: human-written and AI-generated texts exhibit different Part-Of-Speech (POS) n-gram patterns, making certain tokens more informative than others. To address the limitations, we propose SWLD-Joint (Syntax-pattern Weighted Log-likelihood Difference Joint Detection), a calibration-based neural-training-free detector without gradient-based optimization or neural classifier fine-tuning. SWLD-Joint first estimates POS n-gram template weights from labeled calibration data and then combines them with a POS-trajectory calibration signal to focus on syntactically informative positions. Experiments on DetectRL, RAID, and HC3_Ext show robust gains under domain shift, generator mismatch, and adversarial perturbations. Ablations, parameter analysis, case studies, score distributions, and ROC curves verify the effectiveness of syntax-pattern weighting. Code and data will be released upon acceptance.

More from EMNLP 2026

All EMNLP 2026 papers →