dataset evaluation

Cherry-Picking in Time Series Forecasting: How to Select Datasets to Make Your Model Shine AAAI 2025 HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twitter ACL 2025 Label Convergence: Defining an Upper Performance Bound in Object Recognition through Contradictory Annotations WACV 2025 Mind the Gap: A Review of Arabic Post-Training Datasets and Their Limitations EMNLP 2025 Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMs ACL 2025 Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges ACL 2025 SafetyPrompts: A Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety AAAI 2025 From Languages to Geographies: Towards Evaluating Cultural Bias in Hate Speech Datasets NAACL 2024 Hidden in Plain Sight: Evaluating Abstract Shape Recognition in Vision-Language Models NeurIPS 2024 Localization Is All You Evaluate: Data Leakage in Online Mapping Datasets and How to Fix It CVPR 2024 Slot and Intent Detection Resources for Bavarian and Lithuanian: Assessing Translations vs Natural Queries to Digital Assistants COLING 2024 The State of Relation Extraction Data Quality: Is Bigger Always Better? ACL 2024 A New Dataset Based on Images Taken by Blind People for Testing the Robustness of Image Classification Models Trained for ImageNet Categories CVPR 2023 Evaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehension EMNLP 2023 Morphological Inflection: A Reality Check ACL 2023 No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inference ACL 2023 Statistically Profiling Biases in Natural Language Reasoning Datasets and Models EMNLP 2023 Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification NAACL 2022 Dataset Geography: Mapping Language Data to Language Users ACL 2022 Does Audio Deepfake Detection Generalize? Interspeech 2022 Does Recommend-Revise Produce Reliable Annotations? An Analysis on Missing Instances in DocRED ACL 2022 Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements EMNLP 2022 To What Extent Do Natural Language Understanding Datasets Correlate to Logical Reasoning? A Method for Diagnosing Logical Reasoning. COLING 2022 What Do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classification ACL 2022 Beyond Accuracy: A Consolidated Tool for Visual Question Answering Benchmarking EMNLP 2021