Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Choosing the Right Language Mode at Inference Time for Multilingual Reliability

AbstractMultilingual large language models often struggle to reason in low- to mid-resource languages. Prior work has shown that translation can improve multilingual reasoning by helping models access stronger English-centric representations. This raises a central question: how much translation is needed for multilingual large language models to reason reliably, and when does additional translation instead trigger interference and overconfidence? Using LLaMA and Qwen models, we conduct extensive experiments that vary both text scope and language mode (target-only, English-only, and bilingual) to evaluate accuracy and reliability. Our results reveal a clear trade-off: English context often improves understanding and helps recover errors caused by non-English comprehension, yet adding redundant bilingual context can intensify interference. To address this trade-off, we propose Reliability-Aware Adaptive Inference (RAAI), a training-free test-time framework that (i) performs ECE-aware routing and prompt fusion and (ii) uses a mid-layer Risk Index (RI) to gate sequential reasoning, allocating extra compute only when it is likely to help while suppressing harmful bilingual redundancy. Across two model families, RAAI improves accuracy by 25 to 37.7 points in low-resource languages and reduces calibration error by about 3 to 6 points, with the largest gains appearing in the lowest-resource language tiers.

More from EMNLP 2026

All EMNLP 2026 papers →