human annotation

Order Effects in Annotation Tasks: Further Evidence of Annotation Sensitivity EACL 2024 PatentEval: Understanding Errors in Patent Generation NAACL 2024 SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypes ACL 2024 Speech vs. Transcript: Does It Matter for Human Annotators in Speech Summarization? ACL 2024 STAR: SocioTechnical Approach to Red Teaming Language Models EMNLP 2024 The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct Representation COLING 2024 ActiveAED: A Human in the Loop Improves Annotation Error Detection ACL 2023 A Dataset for Physical and Abstract Plausibility and Sources of Human Disagreement ACL 2023 Analyzing Subjectivity Using a Transformer-Based Regressor Trained on Naïve Speakers’ Judgements ACL 2023 Beyond Labels: Empowering Human Annotators with Natural Language Explanations through a Novel Active-Learning Architecture EMNLP 2023 Chinese Lexical Substitution: Dataset and Method EMNLP 2023 COHESENTIA: A Novel Benchmark of Incremental versus Holistic Assessment of Coherence in Generated Texts EMNLP 2023 Comparing Intrinsic Gender Bias Evaluation Measures without using Human Annotated Examples EACL 2023 Ecologically Valid Explanations for Label Variation in NLI EMNLP 2023 Enhancing Human Summaries for Question-Answer Generation in Education ACL 2023 GTCOM and DLUT’s Neural Machine Translation Systems for WMT23 EMNLP 2023 Human Guided Ground-Truth Generation for Realistic Image Super-Resolution CVPR 2023 Modeling Legal Reasoning: LM Annotation at the Edge of Human Agreement EMNLP 2023 On the Limitations of Simulating Active Learning ACL 2023 Promises and Pitfalls of Threshold-based Auto-labeling NeurIPS 2023 Real or Fake Text?: Investigating Human Ability to Detect Boundaries between Human-Written and Machine-Generated Text AAAI 2023 SemEval-2023 Task 11: Learning with Disagreements (LeWiDi) SemEval 2023 Temporal and Second Language Influence on Intra-Annotator Agreement and Stability in Hate Speech Labelling ACL 2023 Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons ACL 2022 A Feasibility Study of Answer-Agnostic Question Generation for Education ACL 2022