Evaluation

Who Holds the Pen? Caricature and Perspective in LLM Retellings of History EMNLP 2025 Who Relies More on World Knowledge and Bias for Syntactic Ambiguity Resolution: Humans or LLMs? NAACL 2025 Why should only High-Resource-Languages have all the fun? Pivot Based Evaluation in Low Resource Setting COLING 2025 WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging ACL 2025 Women, Infamous, and Exotic Beings: A Comparative Study of Honorific Usages in Wikipedia and LLMs for Bengali and Hindi EMNLP 2025 WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation NAACL 2025 Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA ACL 2025 Y-NQ: English-Yorùbá Evaluation dataset for Open-Book Reading Comprehension with Open-Ended Questions ACL 2025 Zero-knowledge LLM hallucination detection and mitigation through fine-grained cross-model consistency EMNLP 2025 Zipf’s and Heaps’ Laws for Tokens and LLM-generated Texts EMNLP 2025 2D-OOB: Attributing Data Contribution Through Joint Valuation Framework NeurIPS 2024 4DBInfer: A 4D Benchmarking Toolbox for Graph-Centric Predictive Modeling on RDBs NeurIPS 2024 A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets NeurIPS 2024 A Call to Reflect on Evaluation Practices for Age Estimation: Comparative Analysis of the State-of-the-Art and a Unified Benchmark CVPR 2024 A Careful Examination of Large Language Model Performance on Grade School Arithmetic NeurIPS 2024 Achilles-Bench: A Challenging Benchmark for Low-Resource Evaluation ACL 2024 A Closer Look at Claim Decomposition NAACL 2024 A Cross-Domain Benchmark for Active Learning NeurIPS 2024 ACUEval: Fine-grained Hallucination Evaluation and Correction for Abstractive Summarization ACL 2024 Adaptive Labeling for Efficient Out-of-distribution Model Evaluation NeurIPS 2024 A Data-Centric Perspective on Evaluating Machine Learning Models for Tabular Data NeurIPS 2024 A Deep Analysis of the Impact of Multiword Expressions and Named Entities on Chinese-English Machine Translations EMNLP 2024 Adversarial Math Word Problem Generation EMNLP 2024 African or European Swallow? Benchmarking Large Vision-Language Models for Fine-Grained Object Classification EMNLP 2024 A General Model for Aggregating Annotations AcrossSimple, Complex, and Multi-object Annotation Tasks (Abstract Reprint) AAAI 2024