conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

Speech vs. Transcript: Does It Matter for Human Annotators in Speech Summarization? ACL 2024
ReproHum #0043-4: Evaluating Summarization Models: investigating the impact of education and language proficiency on reproducibility COLING 2024
A Collection of Pragmatic-Similarity Judgments over Spoken Dialog Utterances COLING 2024
Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction NAACL 2024
ReproHum #0087-01: Human Evaluation Reproduction Report for Generating Fact Checking Explanations COLING 2024
STORYSUMM: Evaluating Faithfulness in Story Summarization EMNLP 2024
Clearer Governmental Communication: Text Simplification with ChatGPT Evaluated by Quantitative and Qualitative Research COLING 2024
Adding Argumentation into Human Evaluation of Long Document Abstractive Summarization: A Case Study on Legal Opinions COLING 2024
How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs? EMNLP 2024
I’m sure you’re a real scholar yourself: Exploring Ironic Content Generation by Large Language Models EMNLP 2024
ReproHum: #0033-03: How Reproducible Are Fluency Ratings of Generated Text? A Reproduction of August et al. 2022 COLING 2024
Automatic, Meta and Human Evaluation for Multimodal Summarization with Multimodal Output NAACL 2024
Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG Evaluation NAACL 2024
MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language EMNLP 2024
ConSiDERS-The-Human Evaluation Framework: Rethinking Human Evaluation for Generative Large Language Models ACL 2024
ReproHum #0927-03: DExpert Evaluation? Reproducing Human Judgements of the Fluency of Generated Text COLING 2024
What Have We Achieved on Non-autoregressive Translation? ACL 2024
ReproHum#0043: Human Evaluation Reproducing Language Model as an Annotator: Exploring Dialogue Summarization on AMI Dataset COLING 2024
Language Models Hallucinate, but May Excel at Fact Verification NAACL 2024
Text Style Transfer Evaluation Using Large Language Models COLING 2024
QGEval: Benchmarking Multi-dimensional Evaluation for Question Generation EMNLP 2024
Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References NAACL 2024
Mothman at SemEval-2024 Task 9: An Iterative System for Chain-of-Thought Prompt Optimization NAACL 2024
ReproHum #0927-3: Reproducing The Human Evaluation Of The DExperts Controlled Text Generation Method COLING 2024
METAL: Towards Multilingual Meta-Evaluation NAACL 2024