human annotation

Proposal: From One-Fit-All to Perspective Aware Modeling ACL 2025 ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation ACL 2025 Revisiting text-to-image evaluation with Gecko: on metrics, prompts, and human rating ICLR 2025 Robustness and Confounders in the Demographic Alignment of LLMs with Human Perceptions of Offensiveness ACL 2025 The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs ACL 2025 Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumption CVPR 2025 Utility-Focused LLM Annotation for Retrieval and Retrieval-Augmented Generation EMNLP 2025 Active Deep Multi-view Clustering IJCAI 2024 Active preference learning for ordering items in- and out-of-sample NeurIPS 2024 AHA: Human-Assisted Out-of-Distribution Generalization and Detection NeurIPS 2024 An Interactive Human-Machine Learning Interface for Collecting and Learning from Complex Annotations IJCAI 2024 Annotator-Centric Active Learning for Subjective NLP Tasks EMNLP 2024 A Survey on Modelling Morality for Text Analysis ACL 2024 Building a Japanese Document-Level Relation Extraction Dataset Assisted by Cross-Lingual Transfer COLING 2024 Characterizing Human and Zero-Shot GPT-3.5 Object-Similarity Judgments NAACL 2024 Diversity-Aware Annotation for Conversational AI Safety COLING 2024 dopanim: A Dataset of Doppelganger Animals with Noisy Annotations from Multiple Humans NeurIPS 2024 Enhancing Text Classification through LLM-Driven Active Learning and Human Annotation EACL 2024 ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models EMNLP 2024 GPT is Not an Annotator: The Necessity of Human Annotation in Fairness Benchmark Construction ACL 2024 How Much Annotation is Needed to Compare Summarization Models? NAACL 2024 HQP: A Human-Annotated Dataset for Detecting Online Propaganda ACL 2024 LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts ACL 2024 Meta-Evaluation of Sentence Simplification Metrics COLING 2024 Navigating Dataset Documentations in AI: A Large-Scale Analysis of Dataset Cards on HuggingFace ICLR 2024