annotation quality

Evaluation of Summarization Systems across Gender, Age, and Race EMNLP 2021 Interrater Disagreement Resolution: A Systematic Procedure to Reach Consensus in Annotation Tasks EACL 2021 Investigating label suggestions for opinion mining in German Covid-19 social media ACL 2021 Learning from Crowds by Modeling Common Confusions AAAI 2021 Quantifying and Avoiding Unfair Qualification Labour in Crowdsourcing ACL 2021 Tools Impact on the Quality of Annotations for Chat Untangling ACL 2021 Validating Label Consistency in NER Data Annotation EMNLP 2021 Annotating argumentation in Swedish social media COLING 2020 A Novel Workflow for Accurately and Efficiently Crowdsourcing Predicate Senses and Argument Labels EMNLP 2020 Bayesian Methods for Semi-supervised Text Annotation COLING 2020 Controlled Crowdsourcing for High-Quality QA-SRL Annotation ACL 2020 Inconsistencies in Crowdsourced Slot-Filling Annotations: A Typology and Identification Methods COLING 2020 Label Error Correction and Generation through Label Relationships AAAI 2020 Maintaining Quality in FEVER Annotation ACL 2020 STARC: Structured Annotations for Reading Comprehension ACL 2020 Understanding the Tradeoff between Cost and Quality of Expert Annotations for Keyphrase Extraction COLING 2020 CrossWeigh: Training Named Entity Tagger from Imperfect Annotations EMNLP 2019 Crowdsourced Hedge Term Disambiguation ACL 2019 Nonsense!: Quality Control via Two-Step Reason Selection for Annotating Local Acceptability and Related Attributes in News Editorials EMNLP 2019 A Probabilistic Annotation Model for Crowdsourcing Coreference EMNLP 2018 Effective Crowdsourcing for a New Type of Summarization Task NAACL 2018 Rethinking the Agreement in Human Evaluation Tasks COLING 2018 YEDDA: A Lightweight Collaborative Text Span Annotation Tool ACL 2018 Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotation ACL 2017 Sequence Effects in Crowdsourced Annotations EMNLP 2017