Skip to content
conftrace_
2026 AACL AACL 2026

The Label-Translation Fallacy: A Four-Layer Validity Protocol for Multilingual Mental Health NLP

AbstractA familiar paper translates an English screener, fits a classifier to the new labels, reports a strong F1, and claims to detect depression in another language community. Standard metrics can look fine while construct equivalence, instrument adaptation, and annotation ecology remain unshown. We call this the label-translation fallacy. Building on unified validity theory, measurement modeling, data statements, and cultural psychiatry, we propose a four-layer reporting protocol (construct, instrument, annotation ecology, and licensed claim) for authors and reviewers at venues such as MultiPsyche. We provide minimal evidence thresholds grounded in COSMIN and psychometric standards, concrete templates for L3 annotation reporting, and a decision tree for mapping evidence to claims. Three one-pass case studies show operationalizability. The contribution is integrative rather than experimental: we combine existing validity tools into an operational checklist so that multilingual mental health metrics are interpreted only as strongly as their constructs allow.

🌉 Interdisciplinary Bridge - Healthcare & Medicine and Interdisciplinary and Natural Language Processing

More from AACL 2026

All AACL 2026 papers →