Lost in Translation: Structured-Span Corruption in Machine-Translated Multilingual Web Corpora
Abstract
AbstractMachine translation of English web text is a default recipe for building multilingual and low-resource corpora. We show that this recipe systematically damages the structured spans embedded in web text—URLs, email addresses, numbers and identifiers, code, markup and quotation delimiters—and that fluency metrics do not reveal the damage. Translating 56,163 span-bearing segments from a CC-MAIN-2026-30 Common Crawl sample into nine typologically diverse languages with NLLB-200, we find that 12.6% of 73,881 structured spans do not survive, ranging from 91.1% for numbers to 50.6% for quotation delimiters. Damage is strongly language-dependent (18.7 points), but in the opposite direction to the obvious prediction: the highest-resource targets are damaged most, an inversion that survives controlling for the systems’ tendency to copy low-resource input through untranslated. Round-trip fluency barely tracks any of this (ρ = 0.48 across languages, p = 0.19; ρ = 0.25 per segment). We pre-registered the study, report the refuted hypothesis alongside the supported ones, and release the annotated parallel-span corpus with an independent re-derivation of every number.