conftrace_

human annotation

115 papers

Explore in graph

Co-occurring keywords

large language model (13587) active learning (1301) text classification (6793) natural language processing (2034) human evaluation (379) language model (4599) model evaluation (445) multilingual nlp (1426) benchmark dataset (635) natural language inference (1287)

Papers

Annotator-Centric Active Learning for Subjective NLP Tasks EMNLP 2024
dopanim: A Dataset of Doppelganger Animals with Noisy Annotations from Multiple Humans NIPS 2024
LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts ACL 2024
ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models EMNLP 2024
Building a Japanese Document-Level Relation Extraction Dataset Assisted by Cross-Lingual Transfer COLING 2024
Enhancing Human Summaries for Question-Answer Generation in Education ACL 2023
Temporal and Second Language Influence on Intra-Annotator Agreement and Stability in Hate Speech Labelling ACL 2023
On the Limitations of Simulating Active Learning ACL 2023
Beyond Labels: Empowering Human Annotators with Natural Language Explanations through a Novel Active-Learning Architecture EMNLP 2023
Promises and Pitfalls of Threshold-based Auto-labeling NIPS 2023
COHESENTIA: A Novel Benchmark of Incremental versus Holistic Assessment of Coherence in Generated Texts EMNLP 2023
ActiveAED: A Human in the Loop Improves Annotation Error Detection ACL 2023
Comparing Intrinsic Gender Bias Evaluation Measures without using Human Annotated Examples EACL 2023
Human Guided Ground-Truth Generation for Realistic Image Super-Resolution CVPR 2023
Ecologically Valid Explanations for Label Variation in NLI EMNLP 2023
A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Models EMNLP 2023
Real or Fake Text?: Investigating Human Ability to Detect Boundaries between Human-Written and Machine-Generated Text AAAI 2023
A Dataset for Physical and Abstract Plausibility and Sources of Human Disagreement ACL 2023
Chinese Lexical Substitution: Dataset and Method EMNLP 2023
GTCOM and DLUT’s Neural Machine Translation Systems for WMT23 EMNLP 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization EMNLP 2023
SemEval-2023 Task 11: Learning with Disagreements (LeWiDi) SEMEVAL 2023
Modeling Legal Reasoning: LM Annotation at the Edge of Human Agreement EMNLP 2023
Analyzing Subjectivity Using a Transformer-Based Regressor Trained on Naïve Speakers’ Judgements ACL 2023
On the Diversity and Limits of Human Explanations NAACL 2022