Evaluation

MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmark ACL 2025 Model Consistency as a Cheap yet Predictive Proxy for LLM Elo Scores EMNLP 2025 Model Evaluation in the Dark: Robust Classifier Metrics with Missing Labels AISTATS 2025 Model Performance-Guided Evaluation Data Selection for Effective Prompt Optimization ACL 2025 MojoBench: Language Modeling and Benchmarks for Mojo NAACL 2025 MolErr2Fix: Benchmarking LLM Trustworthiness in Chemistry via Modular Error Detection, Localization, Explanation, and Correction EMNLP 2025 Morables: A Benchmark for Assessing Abstract Moral Reasoning in LLMs with Fables EMNLP 2025 MultiConIR: Towards Multi-Condition Information Retrieval EMNLP 2025 Multilingual Blending: Large Language Model Safety Alignment Evaluation with Language Mixture NAACL 2025 Multi-LMentry: Can Multilingual LLMs Solve Elementary Tasks Across Languages? EMNLP 2025 MultiLogicNMR(er): A Benchmark and Neural-Symbolic Framework for Non-monotonic Reasoning with Multiple Extensions EMNLP 2025 NarratEX Dataset: Explaining the Dominant Narratives in News Texts EMNLP 2025 neDIOM: Dataset and Analysis of Nepali Idioms COLING 2025 NitiBench: Benchmarking LLM Frameworks on Thai Legal Question Answering Capabilities EMNLP 2025 Noise-Aware Evaluation of Object Detectors WACV 2025 NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Models NAACL 2025 No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size COLING 2025 Not-Just-Scaling Laws: Towards a Better Understanding of the Downstream Impact of Language Model Design Decisions EMNLP 2025 Not Lost After All: How Cross-Encoder Attribution Challenges Position Bias Assumptions in LLM Summarization EMNLP 2025 Not quite Sherlock Holmes: Language model predictions do not reliably differentiate impossible from improbable events ACL 2025 Not What the Doctor Ordered: Surveying LLM-based De-identification and Quantifying Clinical Information Loss EMNLP 2025 NOVA-63: Native Omni-lingual Versatile Assessments of 63 Disciplines EMNLP 2025 NovelCR: A Large-Scale Bilingual Dataset Tailored for Long-Span Coreference Resolution ACL 2025 ODP-Bench: Benchmarking Out-of-Distribution Performance Prediction ICCV 2025 OLMES: A Standard for Language Model Evaluations NAACL 2025