multilingual evaluation

TLUE: A Tibetan Language Understanding Evaluation Benchmark EMNLP 2025 Towards Multi-dimensional Evaluation of LLM Summarization across Domains and Languages ACL 2025 TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages ACL 2025 Understanding and Mitigating Overrefusal in LLMs from an Unveiling Perspective of Safety Decision Boundary EMNLP 2025 AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages NAACL 2024 Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation? EACL 2024 Are Large Language Models Consistent over Value-laden Questions? EMNLP 2024 Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model ACL 2024 BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains ACL 2024 BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages NeurIPS 2024 CAILMD-23 at SemEval-2024 Task 1: Multilingual Evaluation of Semantic Textual Relatedness SemEval 2024 Do Language Models Care about Text Quality? Evaluating Web-Crawled Corpora across 11 Languages COLING 2024 Do Moral Judgment and Reasoning Capability of LLMs Change with Language? A Study using the Multilingual Defining Issues Test EACL 2024 Evaluating ChatGPT against Functionality Tests for Hate Speech Detection COLING 2024 EXAMS-V: A Multi-Discipline Multilingual Multimodal Exam Benchmark for Evaluating Vision Language Models ACL 2024 Highly Intelligible Speaker-Independent Articulatory Synthesis Interspeech 2024 Is It Good Data for Multilingual Instruction Tuning or Just Bad Multilingual Evaluation for Large Language Models? EMNLP 2024 “Knowing When You Don’t Know”: A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation EMNLP 2024 M5 – A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks EMNLP 2024 MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks NAACL 2024 Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models ACL 2024 PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data EMNLP 2024 SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypes ACL 2024 Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the US EMNLP 2024 Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of Arabic EMNLP 2023