Skip to content
conftrace_

multilingual evaluation

99 papers

Papers

Confidence as a Tie-Breaker: Reassessing Multilingual Hedging Bias in LLM-as-a-Judge Evaluation ACL 2026 Evaluation of Multilingual Ability to Use Spatial Deictic Expressions in Vision-Language Models ACL 2026 Is Human-Like Text Liked by Humans? Multilingual Human Detection and Preference Against AI ACL 2026 Knowledge Beyond Language: Bridging the Gap in Multilingual Machine Unlearning Evaluation ACL 2026 LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models ACL 2026 Mind the Gap: Multilingual Divide in LLM Bias Detection and Reasoning ACL 2026 MME-SCI: A Comprehensive and Challenging Science Benchmark for Multimodal Large Language Models AAAI 2026 Quantifying the Impact of Translation Errors on Multilingual LLM Evaluation ACL 2026 SemEval-2026 Task 11: Disentangling Content and Formal Reasoning in Large Language Models SemEval 2026 SemEval-2026 Task 7: Everyday Knowledge Across Diverse Languages and Cultures SemEval 2026 TokLens: A Multilingual Lens on Tokenizer Quality for LLMs ACL 2026 Toward Robust Evaluation for Multilingual Grammatical Error Correction: Can Large Language Models Replace Human References? ACL 2026 UNSC-Bench: Evaluating LLM Diplomatic Role-Playing Through UN Security Council Vote Prediction EACL 2026 When Does Language Matter? Multilingual Instructions Reveal Step-wise Language Sensitivity in Vision-Language-Action Models ACL 2026 XToM: Exploring the Multilingual Theory of Mind for Large Language Models ACL 2026 A Dual-Layered Evaluation of Geopolitical and Cultural Bias in LLMs ACL 2025 Advocating Character Error Rate for Multilingual ASR Evaluation NAACL 2025 An Empirical Analysis of Machine Translation for Expanding Multilingual Benchmarks EMNLP 2025 Batayan: A Filipino NLP benchmark for evaluating Large Language Models ACL 2025 Beyond statistical significance: Quantifying uncertainty and statistical variability in multilingual and multitask NLP evaluation IJCNLP 2025 Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination COLING 2025 Cross-Lingual Auto Evaluation for Assessing Multilingual LLMs ACL 2025 CULEMO: Cultural Lenses on Emotion - Benchmarking LLMs for Cross-Cultural Emotion Understanding ACL 2025 DharmaBench: Evaluating Language Models on Buddhist Texts in Sanskrit and Tibetan IJCNLP 2025 Disentangling Language and Culture for Evaluating Multilingual Large Language Models ACL 2025