conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

Intrinsic Task-based Evaluation for Referring Expression Generation ACL 2024
Meta-Evaluation of Sentence Simplification Metrics COLING 2024
DIALIGHT: Lightweight Multilingual Development and Evaluation of Task-Oriented Dialogue Systems with Large Language Models NAACL 2024
I’m sure you’re a real scholar yourself: Exploring Ironic Content Generation by Large Language Models EMNLP 2024
Knowledge-Centric Templatic Views of Documents EMNLP 2024
ReproHum #0927-03: DExpert Evaluation? Reproducing Human Judgements of the Fluency of Generated Text COLING 2024
Adding Argumentation into Human Evaluation of Long Document Abstractive Summarization: A Case Study on Legal Opinions COLING 2024
Commentator: A Code-mixed Multilingual Text Annotation Framework EMNLP 2024
Text Style Transfer Evaluation Using Large Language Models COLING 2024
Limitations of Human Identification of Automatically Generated Text COLING 2024
Exploring the Impact of Human Evaluator Group on Chat-Oriented Dialogue Evaluation COLING 2024
How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs? EMNLP 2024
Evaluation of Really Good Grammatical Error Correction COLING 2024
Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation COLING 2024
A Collection of Pragmatic-Similarity Judgments over Spoken Dialog Utterances COLING 2024
Findings of the AmericasNLP 2024 Shared Task on Machine Translation into Indigenous Languages NAACL 2024
ReproHum #0927-3: Reproducing The Human Evaluation Of The DExperts Controlled Text Generation Method COLING 2024
Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG Evaluation NAACL 2024
Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling AAAI 2024
METAL: Towards Multilingual Meta-Evaluation NAACL 2024
Clearer Governmental Communication: Text Simplification with ChatGPT Evaluated by Quantitative and Qualitative Research COLING 2024
Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction NAACL 2024
ReproHum: #0033-03: How Reproducible Are Fluency Ratings of Generated Text? A Reproduction of August et al. 2022 COLING 2024
ReproHum#0043: Human Evaluation Reproducing Language Model as an Annotator: Exploring Dialogue Summarization on AMI Dataset COLING 2024
Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability, Reproducibility, and Practicality NIPS 2024