conftrace_

human annotation

115 papers

Explore in graph

Co-occurring keywords

large language model (13587) active learning (1301) text classification (6793) natural language processing (2034) human evaluation (379) language model (4599) model evaluation (445) multilingual nlp (1426) benchmark dataset (635) natural language inference (1287)

Papers

DeepMistake at LSCDiscovery: Can a Multilingual Word-in-Context Model Replace Human Annotators? ACL 2022
Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons ACL 2022
KoBEST: Korean Balanced Evaluation of Significant Tasks COLING 2022
Crowdsourcing Preposition Sense Disambiguation with High Precision via a Priming Task EMNLP 2022
Improving Human Annotation Effectiveness for Fact Collection by Identifying the Most Relevant Answers EMNLP 2022
Analyzing and Evaluating Faithfulness in Dialogue Summarization EMNLP 2022
Sarcasm Detection is Way Too Easy! An Empirical Comparison of Human and Machine Sarcasm Detection EMNLP 2022
A Feasibility Study of Answer-Agnostic Question Generation for Education ACL 2022
Multi-Dimensional, Nuanced and Subjective - Measuring the Perception of Facial Expressions CVPR 2022
FALTE: A Toolkit for Fine-grained Annotation for Long Text Evaluation EMNLP 2022
Does Summary Evaluation Survive Translation to Other Languages? NAACL 2022
Explaining Why: How Instructions and User Interfaces Impact Annotator Rationales When Labeling Text Data NAACL 2022
RoBLEURT Submission for WMT2021 Metrics Task EMNLP 2021
What Motivates You? Benchmarking Automatic Detection of Basic Needs from Short Posts ACL 2021
FAST: Fast Annotation tool for SmarT devices EMNLP 2021
OCNLI: Original Chinese Natural Language Inference EMNLP 2020
Robust Learning from Discriminative Feature Feedback AISTATS 2020
Robustness to Spurious Correlations via Human Annotations ICML 2020
Are we Estimating or Guesstimating Translation Quality? ACL 2020
KeypointNet: A Large-Scale 3D Keypoint Dataset Aggregated From Numerous Human Annotations CVPR 2020
Cost-Effective Interactive Attention Learning with Neural Attention Processes ICML 2020
Less is More: Attention Supervision with Counterfactuals for Text Classification EMNLP 2020
Dual Supervision Framework for Relation Extraction with Distant Supervision and Human Annotation COLING 2020
Predictive Engagement: An Efficient Metric for Automatic Evaluation of Open-Domain Dialogue Systems AAAI 2020
What Can We Learn from Collective Human Opinions on Natural Language Inference Data? EMNLP 2020