multilingual benchmark

IberoBench: A Benchmark for LLM Evaluation in Iberian Languages COLING 2025 Let’s Play Across Cultures: A Large Multilingual, Multicultural Benchmark for Assessing Language Models’ Understanding of Sports EMNLP 2025 Linguistic Generalizability of Test-Time Scaling in Mathematical Reasoning ACL 2025 LORAXBENCH: A Multitask, Multilingual Benchmark Suite for 20 Indonesian Languages EMNLP 2025 Marco-Bench-MIF: On Multilingual Instruction-Following Capability of Large Language ACL 2025 MELAC: Massive Evaluation of Large Language Models with Alignment of Culture in Persian Language IJCNLP 2025 MFTCXplain: A Multilingual Benchmark Dataset for Evaluating the Moral Reasoning of LLMs through Multi-hop Hate Speech Explanation EMNLP 2025 mHumanEval - A Multilingual Benchmark to Evaluate Large Language Models for Code Generation NAACL 2025 M-IFEval: Multilingual Instruction-Following Evaluation NAACL 2025 MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems NAACL 2025 MLaKE: Multilingual Knowledge Editing Benchmark for Large Language Models COLING 2025 MMTEB: Massive Multilingual Text Embedding Benchmark ICLR 2025 MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering ACL 2025 Multi-LMentry: Can Multilingual LLMs Solve Elementary Tasks Across Languages? EMNLP 2025 MultiTEND: A Multilingual Benchmark for Natural Language to NoSQL Query Translation ACL 2025 MultiVENT 2.0: A Massive Multilingual Benchmark for Event-Centric Video Retrieval CVPR 2025 MVL-SIB: A Massively Multilingual Vision-Language Benchmark for Cross-Modal Topical Matching ACL 2025 NOVA-63: Native Omni-lingual Versatile Assessments of 63 Disciplines EMNLP 2025 P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs EMNLP 2025 SeaExam and SeaBench: Benchmarking LLMs with Local Multilingual Questions in Southeast Asia NAACL 2025 SinhalaMMLU: A Comprehensive Benchmark for Evaluating Multitask Language Understanding in Sinhala EMNLP 2025 SwiLTra-Bench: The Swiss Legal Translation Benchmark ACL 2025 Truth Knows No Language: Evaluating Truthfulness Beyond English ACL 2025 VLR-Bench: Multilingual Benchmark Dataset for Vision-Language Retrieval Augmented Generation COLING 2025 WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation EMNLP 2025