Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Typological Features are Multiple-Choice Questions, not Yes/No Questions: Lessons from Typological Feature-Value Embeddings

AbstractWALS and Grambank encode typological information in different forms: WALS assigns one value to each multi-valued feature, whereas Grambank mostly records the availability of constructions. Computational pipelines commonly expand both into independent binary columns. We compare that binary encoding with a categorical objective that jointly normalizes the values of each feature. The models otherwise share architecture, data, optimization and capacity. On WALS, the categorical objective recovers more of the structure implicit in feature definitions: distances track ordinal scales, compositional dimensions become consistent directions, and 45% of cross-feature nearest neighbours share a grammatical domain, compared with 20% for the binary model. The advantage persists under reparameterization-invariant diagnostics. External evaluations show the same pattern: categorical embeddings rank independently supported implicational universals more strongly, recover the two clause orders associated with languages lacking a single dominant order even when the corresponding feature is withheld, and correlate more strongly with corpus word-order variability among languages assigned the same WALS label. Held-out-branch prediction differs less between objectives, especially on Grambank. Preserving feature-level competition therefore changes representation geometry even when predictive accuracy changes little.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Interdisciplinary

More from EMNLP 2026

All EMNLP 2026 papers →