benchmark evaluation

CToolEval: A Chinese Benchmark for LLM-Powered Agent Evaluation in Real-World API Interactions ACL 2024 CURE4Rec: A Benchmark for Recommendation Unlearning with Deeper Influence NeurIPS 2024 CUTE: Measuring LLMs’ Understanding of Their Tokens EMNLP 2024 DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models EMNLP 2024 DanteLLM: Let’s Push Italian LLM Research Forward! COLING 2024 DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA NeurIPS 2024 Data Contamination Calibration for Black-box LLMs ACL 2024 Data Contamination Can Cross Language Barriers EMNLP 2024 DataTales: A Benchmark for Real-World Intelligent Data Narration EMNLP 2024 Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearning ACL 2024 Demonstrating HumanTHOR: A Simulation Platform and Benchmark for Human-Robot Collaboration in a Shared Workspace RSS 2024 Detection, Diagnosis, and Explanation: A Benchmark for Chinese Medical Hallucination Evaluation COLING 2024 Developing a Pragmatic Benchmark for Assessing Korean Legal Language Understanding in Large Language Models EMNLP 2024 DF40: Toward Next-Generation Deepfake Detection NeurIPS 2024 DiaHalu: A Dialogue-level Hallucination Evaluation Benchmark for Large Language Models EMNLP 2024 Difficult Task Yes but Simple Task No: Unveiling the Laziness in Multimodal LLMs EMNLP 2024 Discovery of the Hidden World with Large Language Models NeurIPS 2024 Disordered-DABS: A Benchmark for Dynamic Aspect-Based Summarization in Disordered Texts EMNLP 2024 Dissecting Sample Hardness: A Fine-Grained Analysis of Hardness Characterization Methods for Data-Centric AI ICLR 2024 DocMath-Eval: Evaluating Math Reasoning Capabilities of LLMs in Understanding Long and Specialized Documents ACL 2024 Do Large Language Models Know How Much They Know? EMNLP 2024 Do LLMs Speak Kazakh? A Pilot Evaluation of Seven Models ACL 2024 Do Localization Methods Actually Localize Memorized Data in LLMs? A Tale of Two Benchmarks NAACL 2024 DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures COLING 2024 Do Text-to-Vis Benchmarks Test Real Use of Visualisations? EMNLP 2024