conftrace_

annotation quality

109 papers

Explore in graph

Co-occurring keywords

inter-annotator agreement (134) human evaluation (379) large language model (13587) named entity recognition (2813) text classification (6793) data quality (130) data annotation (101) text annotation (151) natural language processing (2034) active learning (1301)

Papers

Learning from Crowds by Modeling Common Confusions AAAI 2021
Evaluation of Summarization Systems across Gender, Age, and Race EMNLP 2021
Interrater Disagreement Resolution: A Systematic Procedure to Reach Consensus in Annotation Tasks EACL 2021
Investigating label suggestions for opinion mining in German Covid-19 social media IJCNLP 2021
ActiveAnno: General-Purpose Document-Level Annotation Tool with Active Learning Integration NAACL 2021
Agree to Disagree: Analysis of Inter-Annotator Disagreements in Human Evaluation of Machine Translation Output EMNLP 2021
Investigating label suggestions for opinion mining in German Covid-19 social media ACL 2021
Agree to Disagree: Analysis of Inter-Annotator Disagreements in Human Evaluation of Machine Translation Output CONLL 2021
Validating Label Consistency in NER Data Annotation EMNLP 2021
Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability ACL 2021
Quantifying and Avoiding Unfair Qualification Labour in Crowdsourcing ACL 2021
Tools Impact on the Quality of Annotations for Chat Untangling ACL 2021
Inconsistencies in Crowdsourced Slot-Filling Annotations: A Typology and Identification Methods COLING 2020
Bayesian Methods for Semi-supervised Text Annotation COLING 2020
Annotating argumentation in Swedish social media COLING 2020
Understanding the Tradeoff between Cost and Quality of Expert Annotations for Keyphrase Extraction COLING 2020
Label Error Correction and Generation through Label Relationships AAAI 2020
STARC: Structured Annotations for Reading Comprehension ACL 2020
Controlled Crowdsourcing for High-Quality QA-SRL Annotation ACL 2020
A Novel Workflow for Accurately and Efficiently Crowdsourcing Predicate Senses and Argument Labels EMNLP 2020
Maintaining Quality in FEVER Annotation ACL 2020
CrossWeigh: Training Named Entity Tagger from Imperfect Annotations EMNLP 2019
Nonsense!: Quality Control via Two-Step Reason Selection for Annotating Local Acceptability and Related Attributes in News Editorials EMNLP 2019
Crowdsourced Hedge Term Disambiguation ACL 2019
Nonsense!: Quality Control via Two-Step Reason Selection for Annotating Local Acceptability and Related Attributes in News Editorials IJCNLP 2019