evaluation dataset

AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark ACL 2025 A Multi-Dialectal Dataset for German Dialect ASR and Dialect-to-Standard Speech Translation Interspeech 2025 FQ-Eval: Building Evaluation Dataset for User-centered Follow-up Question Generation EMNLP 2025 IndoSafety: Culturally Grounded Safety for LLMs in Indonesian Languages EMNLP 2025 Challenging Large Language Models with New Tasks: A Study on their Adaptability and Robustness ACL 2024 Correcting FLORES Evaluation Dataset for Four African Languages EMNLP 2024 Data Contamination Report from the 2024 CONDA Shared Task ACL 2024 Do Pre-Trained Language Models Detect and Understand Semantic Underspecification? Ask the DUST! ACL 2024 LFED: A Literary Fiction Evaluation Dataset for Large Language Models COLING 2024 SpreadNaLa: A Naturalistic Code Generation Evaluation Dataset of Spreadsheet Formulas COLING 2024 GQG: Generalized Quantifier Generalization - A Dataset for Evaluating Quantifier Semantics Understanding in Language Models EMNLP 2023 A Multilingual Multiway Evaluation Data Set for Structured Document Translation of Asian Languages AACL 2022 Design Guidelines for Inclusive Speaker Verification Evaluation Datasets Interspeech 2022 ILDAE: Instance-Level Difficulty Analysis of Evaluation Data ACL 2022 Investigating Failures of Automatic Translationin the Case of Unambiguous Gender ACL 2022 JADES: New Text Simplification Dataset in Japanese Targeted at Non-Native Speakers EMNLP 2022 MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correction NAACL 2022 ADEPT: A Dataset for Evaluating Prosody Transfer Interspeech 2021 Benchmarking Commonsense Knowledge Base Population with an Effective Evaluation Dataset EMNLP 2021 Developing a Benchmark for Reducing Data Bias in Authorship Attribution EMNLP 2021 FAST: A carefully sampled and cognitively motivated dataset for distributional semantic evaluation CoNLL 2021 A Parallel Evaluation Data Set of Software Documentation with Document Structure Annotation AACL 2020 An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction EMNLP 2019 Lost in Evaluation: Misleading Benchmarks for Bilingual Dictionary Induction EMNLP 2019 Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference ACL 2019