benchmark dataset

DTGB: A Comprehensive Benchmark for Dynamic Text-Attributed Graphs NeurIPS 2024 Easy2Hard-Bench: Standardized Difficulty Labels for Profiling LLM Performance and Generalization NeurIPS 2024 Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articles NAACL 2024 Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline CVPR 2024 ExMatch: Self-guided Exploitation for Semi-Supervised Learning with Scarce Labeled Samples ECCV 2024 Exploring Defeasibility in Causal Reasoning ACL 2024 FISBe: A Real-World Benchmark Dataset for Instance Segmentation of Long-Range Thin Filamentous Structures CVPR 2024 Fit for our purpose, not yours: Benchmark for a low-resource, Indigenous language NeurIPS 2024 FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agents EMNLP 2024 FOLIO: Natural Language Reasoning with First-Order Logic EMNLP 2024 FreeMan: Towards Benchmarking 3D Human Pose Estimation under Real-World Conditions CVPR 2024 From Text Segmentation to Smart Chaptering: A Novel Benchmark for Structuring Video Transcriptions EACL 2024 Fumbling in Babel: An Investigation into ChatGPT’s Language Identification Ability NAACL 2024 GATE X-E : A Challenge Set for Gender-Fair Translations from Weakly-Gendered Languages ACL 2024 GeSS: Benchmarking Geometric Deep Learning under Scientific Applications with Distribution Shifts NeurIPS 2024 GlobeSumm: A Challenging Benchmark Towards Unifying Multi-lingual, Cross-lingual and Multi-document News Summarization EMNLP 2024 GlucoBench: Curated List of Continuous Glucose Monitoring Datasets with Prediction Benchmarks ICLR 2024 GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI NeurIPS 2024 GuardBench: A Large-Scale Benchmark for Guardrail Models EMNLP 2024 HeSum: a Novel Dataset for Abstractive Text Summarization in Hebrew ACL 2024 How Robust Are the QA Models for Hybrid Scientific Tabular Data? A Study Using Customized Dataset COLING 2024 HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations AAAI 2024 imapScore: Medical Fact Evaluation Made Easy ACL 2024 IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localization NeurIPS 2024 IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Context NAACL 2024