benchmark evaluation

CK12: A Rounded K12 Knowledge Graph Based Benchmark for Chinese Holistic Cognition Evaluation AAAI 2024 CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models ACL 2024 CLEAN–EVAL: Clean Evaluation on Contaminated Large Language Models NAACL 2024 CLEAR: Can Language Models Really Understand Causal Graphs? EMNLP 2024 CLOMO: Counterfactual Logical Modification with Large Language Models ACL 2024 CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models EMNLP 2024 CMMLU: Measuring massive multitask language understanding in Chinese ACL 2024 Codec-SUPERB: An In-Depth Analysis of Sound Codec Models ACL 2024 CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation ACL 2024 CODIS: Benchmarking Context-dependent Visual Comprehension for Multimodal Large Language Models ACL 2024 CogGPT: Unleashing the Power of Cognitive Dynamics on Large Language Models EMNLP 2024 CoIN: A Benchmark of Continual Instruction Tuning for Multimodel Large Language Models NeurIPS 2024 Collaboration or Corporate Capture? Quantifying NLP’s Reliance on Industry Artifacts and Contributions ACL 2024 ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large Language Models ACL 2024 ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficulty NeurIPS 2024 CoNLL#: Fine-grained Error Analysis and a Corrected Test Set for CoNLL-03 English COLING 2024 ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs NeurIPS 2024 Connecting the Dots: Evaluating Abstract Reasoning Capabilities of LLMs Using the New York Times Connections Word Game EMNLP 2024 ConStat: Performance-Based Contamination Detection in Large Language Models NeurIPS 2024 Constructing Domain-Specific Evaluation Sets for LLM-as-a-judge EMNLP 2024 CONSTRUCTURE: Benchmarking CONcept STRUCTUre REasoning for Multimodal Large Language Models EMNLP 2024 CRAG - Comprehensive RAG Benchmark NeurIPS 2024 CriticBench: Benchmarking LLMs for Critique-Correct Reasoning ACL 2024 CriticEval: Evaluating Large-scale Language Model as Critic NeurIPS 2024 CTIBench: A Benchmark for Evaluating LLMs in Cyber Threat Intelligence NeurIPS 2024