multilingual evaluation

Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledge NAACL 2025 Evaluating Text Style Transfer Evaluation: Are There Any Reliable Metrics? NAACL 2025 FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation NAACL 2025 Gender Bias in Large Language Models across Multiple Languages: A Case Study of ChatGPT NAACL 2025 Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation ACL 2025 GlotEval: A Test Suite for Massively Multilingual Evaluation of Large Language Models EMNLP 2025 HKCanto-Eval: A Benchmark for Evaluating Cantonese Language Understanding and Cultural Comprehension in LLMs CoNLL 2025 How Reliable is Multilingual LLM-as-a-Judge? EMNLP 2025 It Depends: Resolving Referential Ambiguity in Minimal Contexts with Commonsense Knowledge EMNLP 2025 KazMMLU: Evaluating Language Models on Kazakh, Russian, and Regional Knowledge of Kazakhstan ACL 2025 La Leaderboard: A Large Language Model Leaderboard for Spanish Varieties and Languages of Spain and Latin America ACL 2025 MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMs EMNLP 2025 MEMERAG: A Multilingual End-to-End Meta-Evaluation Benchmark for Retrieval Augmented Generation ACL 2025 MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment ACL 2025 M-IFEval: Multilingual Instruction-Following Evaluation NAACL 2025 Mind the Inclusivity Gap: Multilingual Gender-Neutral Translation Evaluation with mGeNTE EMNLP 2025 M-RewardBench: Evaluating Reward Models in Multilingual Settings ACL 2025 OpenHuEval: Evaluating Large Language Model on Hungarian Specifics ACL 2025 Persian in a Court: Benchmarking VLMs In Persian Multi-Modal Tasks COLING 2025 P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs EMNLP 2025 SEA-HELM: Southeast Asian Holistic Evaluation of Language Models ACL 2025 Swushroomsia at SemEval-2025 Task 3: Probing LLMs’ Collective Intelligence for Multilingual Hallucination Detection SemEval 2025 Test Set Quality in Multilingual LLM Evaluation AACL 2025 Thai Winograd Schemas: A Benchmark for Thai Commonsense Reasoning COLING 2025 Think Globally, Group Locally: Evaluating LLMs Using Multi-Lingual Word Grouping Games EMNLP 2025