language model evaluation

Bhaasha, Bhāṣā, Zaban: A Survey for Low-Resourced Languages in South Asia – Current Stage and Challenges EMNLP 2025 Blind Men and the Elephant: Diverse Perspectives on Gender Stereotypes in Benchmark Datasets EMNLP 2025 BLiSS: Evaluating Bilingual Learner Competence in Second Language Small Language Models EMNLP 2025 C2LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation ACL 2025 Can Large Language Models Outperform Non-Experts in Poetry Evaluation? A Comparative Study Using the Consensual Assessment Technique EMNLP 2025 Can Large Language Models Unlock Novel Scientific Research Ideas? EMNLP 2025 Challenging Multimodal LLMs with African Standardized Exams: A Document VQA Evaluation ACL 2025 CHATTER: A character-attribution dataset for narrative understanding NAACL 2025 CoKe: Customizable Fine-Grained Story Evaluation via Chain-of-Keyword Rationalization ACL 2025 Com2 : A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models ACL 2025 Compositionality and Event Retrieval in Complement Coercion: A Study of Language Models in a Low-resource Setting CoNLL 2025 CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation ACL 2025 Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede’s Cultural Dimensions COLING 2025 DharmaBench: Evaluating Language Models on Buddhist Texts in Sanskrit and Tibetan IJCNLP 2025 Direct Judgement Preference Optimization EMNLP 2025 DMT-RoleBench: A Dynamic Multi-Turn Dialogue Based Benchmark for Role-Playing Evaluation of Large Language Model and Agent AAAI 2025 Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions NAACL 2025 Do Language Models Understand Honorific Systems in Javanese? ACL 2025 Do Language Models Understand the Cognitive Tasks Given to Them? Investigations with the N-Back Paradigm ACL 2025 DUTJBD at SemEval-2025 Task 3: A Range of Approaches for Predicting Hallucination Generation in Models SemEval 2025 EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Models EMNLP 2025 EnDive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Models EMNLP 2025 Evaluating Dialect Robustness of Language Models via Conversation Understanding COLING 2025 Evaluating LLMs with Multiple Problems at once ACL 2025 Evaluating Numeracy of Language Models as a Natural Language Inference Task NAACL 2025