conftrace_

human annotation

115 papers

Explore in graph

Co-occurring keywords

large language model (13587) active learning (1301) text classification (6793) natural language processing (2034) human evaluation (379) language model (4599) model evaluation (445) multilingual nlp (1426) benchmark dataset (635) natural language inference (1287)

Papers

CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data ACL 2026
Forest vs Tree: The (N, K) Trade-off in Reproducible ML Evaluation AAAI 2026
Can Reasoning Help Large Language Models Capture Human Annotator Disagreement? EACL 2026
Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumption CVPR 2025
Proposal: From One-Fit-All to Perspective Aware Modeling ACL 2025
Cheems: A Practical Guidance for Building and Evaluating Chinese Reward Models from Scratch ACL 2025
Evaluating WMT 2025 Metrics Shared Task Submissions on the SSA-MTE African Challenge Set EMNLP 2025
Are Humans as Brittle as Large Language Models? IJCNLP 2025
CNNSum: Exploring Long-Context Summarization with Large Language Models in Chinese Novels ACL 2025
Utility-Focused LLM Annotation for Retrieval and Retrieval-Augmented Generation EMNLP 2025
Did the Writer Actually Visit the Location? Analysis of Location Reviews from Visit Experience IJCNLP 2025
The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs ACL 2025
Bridging the Socioeconomic Gap in Education: A Hybrid AI and Human Annotation Approach ACL 2025
Can LLMs Rank the Harmfulness of Smaller LLMs? We are Not There Yet ACL 2025
ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation ACL 2025
Can Unconfident LLM Annotations Be Used for Confident Conclusions? NAACL 2025
A Little Human Data Goes A Long Way ACL 2025
Chain-of-Talkers (CoTalk): Fast Human Annotation of Dense Image Captions EMNLP 2025
PLLuM-Align: Polish Preference Dataset for Large Language Model Alignment EMNLP 2025
OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation CVPR 2025
Robustness and Confounders in the Demographic Alignment of LLMs with Human Perceptions of Offensiveness ACL 2025
CiteEval: Principle-Driven Citation Evaluation for Source Attribution ACL 2025
LLMs as Medical Safety Judges: Evaluating Alignment with Human Annotation in Patient-Facing QA ACL 2025
Measuring Label Ambiguity in Subjective Tasks using Predictive Uncertainty Estimation ACL 2025
“Feels Feminine to Me”: Understanding Perceived Gendered Style through Human Annotations EMNLP 2025