Evaluation

Data Contamination Calibration for Black-box LLMs ACL 2024 Data Contamination Can Cross Language Barriers EMNLP 2024 Data Mixture Inference Attack: BPE Tokenizers Reveal Training Data Compositions NeurIPS 2024 DataTales: A Benchmark for Real-World Intelligent Data Narration EMNLP 2024 Data Thinning for Convolution-Closed Distributions JMLR 2024 DebugBench: Evaluating Debugging Capability of Large Language Models ACL 2024 Decompose and Compare Consistency: Measuring VLMs’ Answer Reliability via Task-Decomposition Consistency Comparison EMNLP 2024 Demonstrating Arena 3.0: Advancing Social Navigation in Collaborative and Highly Dynamic Environments RSS 2024 DeRDaVa: Deletion-Robust Data Valuation for Machine Learning AAAI 2024 Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models NeurIPS 2024 Differentially Private Equivalence Testing for Continuous Distributions and Applications NeurIPS 2024 Different Tastes of Entities: Investigating Human Label Variation in Named Entity Annotations EACL 2024 DiLiGenRT: A Photometric Stereo Dataset with Quantified Roughness and Translucency CVPR 2024 DINGO: Towards Diverse and Fine-Grained Instruction-Following Evaluation AAAI 2024 Do great minds think alike? Investigating Human-AI Complementarity in Question Answering with CAIMIRA EMNLP 2024 Do Large Language Models Know How Much They Know? EMNLP 2024 Do LLMs Overcome Shortcut Learning? An Evaluation of Shortcut Challenges in Large Language Models EMNLP 2024 Donkii: Characterizing and Detecting Errors in Instruction-Tuning Datasets EACL 2024 Do Vision and Language Encoders Represent the World Similarly? CVPR 2024 Dr.Academy: A Benchmark for Evaluating Questioning Capability in Education for Large Language Models ACL 2024 EASSE-DE & EASSE-multi: Easier Automatic Sentence Simplification Evaluation for German & Multiple Languages EMNLP 2024 Easy2Hard-Bench: Standardized Difficulty Labels for Profiling LLM Performance and Generalization NeurIPS 2024 EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential Reasoning EMNLP 2024 ECON: On the Detection and Resolution of Evidence Conflicts EMNLP 2024 Efficient Lifelong Model Evaluation in an Era of Rapid Progress NeurIPS 2024