Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Coverage Is Not Enough: A Controlled Study of Annotation Selection for Low-Resource Sign Language

AbstractExpert annotation is a central bottleneck in sign-language corpus construction. A natural assumption is that annotation budgets should prioritize diverse or underrepresented signing patterns. We test this in a controlled retrospective study on PHOENIX14T (German Sign Language) and Isharah (Saudi Sign Language), across gloss recognition, translation, multiple budgets, and three seeds, comparing random sampling against geometric, active-learning, pose-derived articulatory, and privileged selectors. Articulatory coverage is generally weak across all four corpus–task settings and rarely outperforms random sampling. A density analysis shows it selects locally atypical clips even after controlling for duration; removing the sparsest 10–20% helps at larger budgets but never enough to beat random. A privileged gloss-diversity oracle also performs poorly despite selecting comparatively typical clips, showing that atypicality is not the whole explanation. Facility-location representativeness is the strongest feasible selector in three of four largest-budget settings, with lower WER than random in 16 of 18 seed-matched recognition comparisons, compared with only 2 of 18 for articulatory-only selection. The results suggest pose-derived articulatory coverage and gloss-type coverage, as operationalized here, are unreliable proxies for annotation utility in low-resource sign-language corpus construction. The source code is available at https://github.com/gyan-shrestha/WSLP-2026.

More from EMNLP 2026

All EMNLP 2026 papers →