nlp evaluation

Beyond Hate Speech: NLP’s Challenges and Opportunities in Uncovering Dehumanizing Language EMNLP 2025 Confidence and Stability of Global and Pairwise Scores in NLP Evaluation ACL 2025 Findings of the VarDial Evaluation Campaign 2025: The NorSID Shared Task on Norwegian Slot, Intent and Dialect Identification COLING 2025 LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks ACL 2025 Standard Quality Criteria Derived from Current NLP Evaluations for Guiding Evaluation Design and Grounding Comparability and AI Compliance Assessments ACL 2025 The 2025 ReproNLP Shared Task on Reproducibility of Evaluations in NLP: Overview and Results ACL 2025 We Need to Measure Data Diversity in NLP — Better and Broader EMNLP 2025 An Audit on the Perspectives and Challenges of Hallucinations in NLP EMNLP 2024 ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews ACL 2024 DIALECTBENCH: An NLP Benchmark for Dialects, Varieties, and Closely-Related Languages ACL 2024 ECBD: Evidence-Centered Benchmark Design for NLP ACL 2024 Human-Centered Evaluation of Language Technologies EMNLP 2024 Language Resources From Prominent Born-Digital Humanities Texts are Still Needed in the Age of LLMs EMNLP 2024 SynthEval: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists EMNLP 2024 A Discerning Several Thousand Judgments: GPT-3 Rates the Article + Adjective + Numeral + Noun Construction EACL 2023 Evaluation for Change ACL 2023 Exploring Variation of Results from Different Experimental Conditions ACL 2023 GlobalBench: A Benchmark for Global Progress in Natural Language Processing EMNLP 2023 NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark EMNLP 2023 Non-Repeatable Experiments and Non-Reproducible Results: The Reproducibility Crisis in Human Evaluation in NLP ACL 2023 Responsible AI Considerations in Text Summarization Research: A Review of Current Practices EMNLP 2023 The NLP Task Effectiveness of Long-Range Transformers EACL 2023 A Robustness Evaluation Framework for Argument Mining COLING 2022 A Survey of Recent Error Annotation Schemes for Automatically Generated Text EMNLP 2022 Contrast Sets for Stativity of English Verbs in Context COLING 2022