benchmark evaluation

BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices NeurIPS 2024 Beyond Aesthetics: Cultural Competence in Text-to-Image Models NeurIPS 2024 Beyond Document Page Classification: Design, Datasets, and Challenges WACV 2024 Beyond the Numbers: Transparency in Relation Extraction Benchmark Creation and Leaderboards EMNLP 2024 BIGOS V2 Benchmark for Polish ASR: Curated Datasets and Tools for Reproducible Evaluation NeurIPS 2024 BLADE: Benchmarking Language Model Agents for Data-Driven Science EMNLP 2024 BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages NeurIPS 2024 BloomVQA: Assessing Hierarchical Multi-modal Comprehension ACL 2024 BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer NAACL 2024 BUST: Benchmark for the evaluation of detectors of LLM-Generated Text NAACL 2024 Can Large Language Models Understand Context? EACL 2024 Can Large Language Models Understand Real-World Complex Instructions? AAAI 2024 Can Large Multimodal Models Uncover Deep Semantics Behind Images? ACL 2024 Can LLM Graph Reasoning Generalize beyond Pattern Memorization? EMNLP 2024 Can LLMs Solve Molecule Puzzles? A Multimodal Benchmark for Molecular Structure Elucidation NeurIPS 2024 CARE: Extracting Experimental Findings From Clinical Literature NAACL 2024 Categorical Syllogisms Revisited: A Review of the Logical Reasoning Abilities of LLMs for Analyzing Categorical Syllogisms EMNLP 2024 CausalBench: A Comprehensive Benchmark for Evaluating Causal Reasoning Capabilities of Large Language Models ACL 2024 CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models ACL 2024 Challenges to Evaluating the Generalization of Coreference Resolution Models: A Measurement Modeling Perspective ACL 2024 Challenging Large Language Models with New Tasks: A Study on their Adaptability and Robustness ACL 2024 CHARP: Conversation History AwaReness Probing for Knowledge-grounded Dialogue Systems ACL 2024 CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs NeurIPS 2024 CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models ACL 2024 CiteME: Can Language Models Accurately Cite Scientific Claims? NeurIPS 2024