Skip to content
conftrace_
2026 EMNLP EMNLP 2026

AquaCrisis: A Multilingual Benchmark for Classifying Water-Utility Public Communication

AbstractWater utilities communicate both routine service information and time-sensitive public-risk guidance, yet multilingual NLP benchmarks for institution-authored infrastructure communication remain limited. We introduce AquaCrisis, a corpus of 20,000 text-bearing Facebook posts from 12 European water utilities, with a 1,500-post manually annotated gold standard. We formulate Task A as classification of a post’s main water-utility topic and Task B as classification of its primary communicative function, together with a coarser grouped Task B.1. We compare rule-based and supervised classifiers with four instruction-tuned LLMs on native-language and English-translated inputs. Supervised approaches achieve the highest point estimates on the fine-grained tasks: translated TF-IDF with logistic regression performs best on Task A, while translated multilingual sentence embeddings perform best on Task B. GPT-4o-mini achieves the highest point estimate on grouped Task B.1. Paired bootstrap analysis shows that translation effects are model- and setting-dependent: gains are clearest for the lexical TF-IDF classifier and selected Gemma 4 and GPT-4.1-mini conditions, while multilingual sentence embeddings, GPT-4o-mini, and Qwen 3.5 are comparatively stable across input representations. AquaCrisis provides a benchmark for multilingual water-utility communication spanning routine, educational, operational, and incident-related messaging, supporting communication monitoring, operational triage, and cross-lingual evaluation.

More from EMNLP 2026

All EMNLP 2026 papers →