conftrace_

dataset evaluation

48 papers

Explore in graph

Co-occurring keywords

benchmark evaluation (1556) natural language understanding (846) question answering (2963) text classification (6793) machine reading comprehension (430) named entity recognition (2813) relation extraction (919) natural language inference (1287) annotation error (22) dataset annotation (72)

Papers

Label Convergence: Defining an Upper Performance Bound in Object Recognition through Contradictory Annotations WACV 2025
SafetyPrompts: A Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety AAAI 2025
Cherry-Picking in Time Series Forecasting: How to Select Datasets to Make Your Model Shine AAAI 2025
Mind the Gap: A Review of Arabic Post-Training Datasets and Their Limitations EMNLP 2025
Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMs ACL 2025
Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges ACL 2025
HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twitter ACL 2025
Hidden in Plain Sight: Evaluating Abstract Shape Recognition in Vision-Language Models NIPS 2024
From Languages to Geographies: Towards Evaluating Cultural Bias in Hate Speech Datasets NAACL 2024
The State of Relation Extraction Data Quality: Is Bigger Always Better? ACL 2024
Localization Is All You Evaluate: Data Leakage in Online Mapping Datasets and How to Fix It CVPR 2024
Slot and Intent Detection Resources for Bavarian and Lithuanian: Assessing Translations vs Natural Queries to Digital Assistants COLING 2024
Evaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehension EMNLP 2023
Statistically Profiling Biases in Natural Language Reasoning Datasets and Models EMNLP 2023
A New Dataset Based on Images Taken by Blind People for Testing the Robustness of Image Classification Models Trained for ImageNet Categories CVPR 2023
No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inference ACL 2023
Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification NAACL 2022
Dataset Geography: Mapping Language Data to Language Users ACL 2022
Does Audio Deepfake Detection Generalize? INTERSPEECH 2022
To What Extent Do Natural Language Understanding Datasets Correlate to Logical Reasoning? A Method for Diagnosing Logical Reasoning. COLING 2022
Does Recommend-Revise Produce Reliable Annotations? An Analysis on Missing Instances in DocRED ACL 2022
Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements EMNLP 2022
What Do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classification ACL 2022
Comparing Test Sets with Item Response Theory IJCNLP 2021
FAST: A carefully sampled and cognitively motivated dataset for distributional semantic evaluation EMNLP 2021