conftrace_

multilingual evaluation

104 papers

Explore in graph

Co-occurring keywords

large language model (13587) low-resource language (2273) multilingual nlp (1426) benchmark evaluation (1556) machine translation (2499) evaluation benchmark (257) language model (4599) language model evaluation (227) natural language processing (2034) cross-lingual transfer (1477)

Papers

Evaluation of Multilingual Ability to Use Spatial Deictic Expressions in Vision-Language Models ACL 2026
MME-SCI: A Comprehensive and Challenging Science Benchmark for Multimodal Large Language Models AAAI 2026
Quantifying the Impact of Translation Errors on Multilingual LLM Evaluation ACL 2026
Mind the Gap: Multilingual Divide in LLM Bias Detection and Reasoning ACL 2026
LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models ACL 2026
UNSC-Bench: Evaluating LLM Diplomatic Role-Playing Through UN Security Council Vote Prediction EACL 2026
Is Human-Like Text Liked by Humans? Multilingual Human Detection and Preference Against AI ACL 2026
Knowledge Beyond Language: Bridging the Gap in Multilingual Machine Unlearning Evaluation ACL 2026
Confidence as a Tie-Breaker: Reassessing Multilingual Hedging Bias in LLM-as-a-Judge Evaluation ACL 2026
When Does Language Matter? Multilingual Instructions Reveal Step-wise Language Sensitivity in Vision-Language-Action Models ACL 2026
TokLens: A Multilingual Lens on Tokenizer Quality for LLMs ACL 2026
Toward Robust Evaluation for Multilingual Grammatical Error Correction: Can Large Language Models Replace Human References? ACL 2026
XToM: Exploring the Multilingual Theory of Mind for Large Language Models ACL 2026
Thai Winograd Schemas: A Benchmark for Thai Commonsense Reasoning COLING 2025
Beyond statistical significance: Quantifying uncertainty and statistical variability in multilingual and multitask NLP evaluation IJCNLP 2025
Disentangling Language and Culture for Evaluating Multilingual Large Language Models ACL 2025
DharmaBench: Evaluating Language Models on Buddhist Texts in Sanskrit and Tibetan IJCNLP 2025
HKCanto-Eval: A Benchmark for Evaluating Cantonese Language Understanding and Cultural Comprehension in LLMs CONLL 2025
CULEMO: Cultural Lenses on Emotion - Benchmarking LLMs for Cross-Cultural Emotion Understanding ACL 2025
Mind the Inclusivity Gap: Multilingual Gender-Neutral Translation Evaluation with mGeNTE EMNLP 2025
P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs EMNLP 2025
Persian in a Court: Benchmarking VLMs In Persian Multi-Modal Tasks COLING 2025
Think Globally, Group Locally: Evaluating LLMs Using Multi-Lingual Word Grouping Games EMNLP 2025
GlotEval: A Test Suite for Massively Multilingual Evaluation of Large Language Models EMNLP 2025
OpenHuEval: Evaluating Large Language Model on Hungarian Specifics ACL 2025