conftrace_

multilingual evaluation

104 papers

Explore in graph

Co-occurring keywords

large language model (13587) low-resource language (2273) multilingual nlp (1426) benchmark evaluation (1556) machine translation (2499) evaluation benchmark (257) language model (4599) language model evaluation (227) natural language processing (2034) cross-lingual transfer (1477)

Papers

DharmaBench: Evaluating Language Models on Buddhist Texts in Sanskrit and Tibetan IJCNLP 2025
Found in Translation: Measuring Multilingual LLM Consistency as Simple as Translate then Evaluate AACL 2025
Disentangling Language and Culture for Evaluating Multilingual Large Language Models ACL 2025
Thai Winograd Schemas: A Benchmark for Thai Commonsense Reasoning COLING 2025
GIL-IIMAS UNAM at SemEval-2025 Task 3: MeSSI: A Multilmodule System to detect hallucinated Segments in trivia-like Inquiries. ACL 2025
Mind the Inclusivity Gap: Multilingual Gender-Neutral Translation Evaluation with mGeNTE EMNLP 2025
SEA-HELM: Southeast Asian Holistic Evaluation of Language Models ACL 2025
TLUE: A Tibetan Language Understanding Evaluation Benchmark EMNLP 2025
LITMUS++ : An Agentic System for Predictive Analysis of Low-Resource Languages Across Tasks and Models AACL 2025
FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation NAACL 2025
MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment ACL 2025
M-IFEval: Multilingual Instruction-Following Evaluation NAACL 2025
Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation ACL 2025
Gender Bias in Large Language Models across Multiple Languages: A Case Study of ChatGPT NAACL 2025
Understanding and Mitigating Overrefusal in LLMs from an Unveiling Perspective of Safety Decision Boundary EMNLP 2025
TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages ACL 2025
Towards Multi-dimensional Evaluation of LLM Summarization across Domains and Languages ACL 2025
Persian in a Court: Benchmarking VLMs In Persian Multi-Modal Tasks COLING 2025
Swushroomsia at SemEval-2025 Task 3: Probing LLMs’ Collective Intelligence for Multilingual Hallucination Detection SEMEVAL 2025
P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs EMNLP 2025
Test Set Quality in Multilingual LLM Evaluation IJCNLP 2025
Cross-Lingual Auto Evaluation for Assessing Multilingual LLMs ACL 2025
HKCanto-Eval: A Benchmark for Evaluating Cantonese Language Understanding and Cultural Comprehension in LLMs CONLL 2025
Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination COLING 2025
Advocating Character Error Rate for Multilingual ASR Evaluation NAACL 2025