conftrace_

multilingual evaluation

104 papers

Explore in graph

Co-occurring keywords

large language model (13587) low-resource language (2273) multilingual nlp (1426) benchmark evaluation (1556) machine translation (2499) evaluation benchmark (257) language model (4599) language model evaluation (227) natural language processing (2034) cross-lingual transfer (1477)

Papers

It Depends: Resolving Referential Ambiguity in Minimal Contexts with Commonsense Knowledge EMNLP 2025
M-RewardBench: Evaluating Reward Models in Multilingual Settings ACL 2025
TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages ACL 2025
Cross-Lingual Auto Evaluation for Assessing Multilingual LLMs ACL 2025
La Leaderboard: A Large Language Model Leaderboard for Spanish Varieties and Languages of Spain and Latin America ACL 2025
A Dual-Layered Evaluation of Geopolitical and Cultural Bias in LLMs ACL 2025
SEA-HELM: Southeast Asian Holistic Evaluation of Language Models ACL 2025
TLUE: A Tibetan Language Understanding Evaluation Benchmark EMNLP 2025
PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data EMNLP 2024
Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models ACL 2024
Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the US EMNLP 2024
SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypes ACL 2024
BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages NIPS 2024
CAILMD-23 at SemEval-2024 Task 1: Multilingual Evaluation of Semantic Textual Relatedness SEMEVAL 2024
M5 – A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks EMNLP 2024
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation? EACL 2024
“Knowing When You Don’t Know”: A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation EMNLP 2024
Do Language Models Care about Text Quality? Evaluating Web-Crawled Corpora across 11 Languages COLING 2024
Evaluating ChatGPT against Functionality Tests for Hate Speech Detection COLING 2024
Are Large Language Models Consistent over Value-laden Questions? EMNLP 2024
MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks NAACL 2024
Do Moral Judgment and Reasoning Capability of LLMs Change with Language? A Study using the Multilingual Defining Issues Test EACL 2024
EXAMS-V: A Multi-Discipline Multilingual Multimodal Exam Benchmark for Evaluating Vision Language Models ACL 2024
AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages NAACL 2024
Highly Intelligible Speaker-Independent Articulatory Synthesis INTERSPEECH 2024