inter-annotator agreement

The RST Continuity Corpus ACL 2023 TIMELINE: Exhaustive Annotation of Temporal Relations Supporting the Automatic Ordering of Events in News Articles EMNLP 2023 Unified Syntactic Annotation of English in the CGEL Framework ACL 2023 Achieving Reliable Human Assessment of Open-Domain Dialogue Systems ACL 2022 Anaphoric Phenomena in Situated dialog: A First Round of Annotations COLING 2022 Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation EMNLP 2022 Directions for NLP Practices Applied to Online Hate Speech Detection EMNLP 2022 Inter-annotator agreement is not the ceiling of machine learning performance: Evidence from a comprehensive set of simulations ACL 2022 NARC – Norwegian Anaphora Resolution Corpus COLING 2022 NLPSharedTasks: A Corpus of Shared Task Overview Papers in Natural Language Processing Domains AACL 2022 On reporting scores and agreement for error annotation tasks EMNLP 2022 Reproducibility and Automation of the Appraisal Taxonomy COLING 2022 SenTag: A Web-Based Tool for Semantic Annotation of Textual Documents AAAI 2022 TS-ANNO: An Annotation Tool to Build, Annotate and Evaluate Text Simplification Corpora ACL 2022 Emotion-Aware, Emotion-Agnostic, or Automatic: Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations EACL 2021 Emotion Ratings: How Intensity, Annotation Confidence and Agreements are Entangled EACL 2021 Evaluation Guidelines to Deal with Implicit Phenomena to Assess Factuality in Data-to-Text Generation ACL 2021 Investigating label suggestions for opinion mining in German Covid-19 social media ACL 2021 Neural Media Bias Detection Using Distant Supervision With BABE - Bias Annotations By Experts EMNLP 2021 On User Interfaces for Large-Scale Document-Level Human Evaluation of Machine Translation Outputs EACL 2021 Quantifying Contextual Aspects of Inter-annotator Agreement in Intertextuality Research EMNLP 2021 Subcategorizing Adverbials in Universal Conceptual Cognitive Annotation EMNLP 2021 Towards Document-Level Human MT Evaluation: On the Issues of Annotator Agreement, Effort and Misevaluation EACL 2021 We Need to Consider Disagreement in Evaluation ACL 2021 Annotating argumentation in Swedish social media COLING 2020