conftrace_

reproducibility study

22 papers

Explore in graph

Co-occurring keywords · papers mentioning both

human evaluation (14) inter-annotator agreement (6) natural language generation (4) natural language processing (4) evaluation methodology (3) text generation (3) dialogue summarization (2) language model (2) paraphrase generation (2) sentiment transfer (1)

Papers

Benchmarking the Benchmarks: Reproducing Climate-Related NLP Tasks ACL 2025 ReproHum #0033-05: Human Evaluation of Factuality from A Multidisciplinary Perspective ACL 2025 ReproHum #0067-01: A Reproduction of the Evaluation of Cross-Lingual Summarization ACL 2025 ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation ACL 2025 ReproHum #0729-04: Partial reproduction of the human evaluation of the MemSum and NeuSum summarisation systems ACL 2025 ReproHum: #0744-02: Investigating the Reproducibility of Semantic Preservation Human Evaluations ACL 2025 A Reproducibility Study on Quantifying Language Similarity: The Impact of Missing Values in the URIEL Knowledge Base NAACL 2024 Beyond Sentence-level Text Simplification: Reproducibility Study of Context-Aware Document Simplification COLING 2024 Is there Gender Bias in Dependency Parsing? Revisiting “Women’s Syntactic Resilience” ACL 2024 Keyphrase Generation: Lessons from a Reproducibility Study COLING 2024 ReproHum: #0033-03: How Reproducible Are Fluency Ratings of Generated Text? A Reproduction of August et al. 2022 COLING 2024 ReproHum #0033-3: Comparable Relative Results with Lower Absolute Values in a Reproduction Study COLING 2024 ReproHum #0043-4: Evaluating Summarization Models: investigating the impact of education and language proficiency on reproducibility COLING 2024 ReproHum#0043: Human Evaluation Reproducing Language Model as an Annotator: Exploring Dialogue Summarization on AMI Dataset COLING 2024 ReproHum #0087-01: A Reproduction Study of the Human Evaluation of the Coverage of Fact Checking Explanations COLING 2024 ReproHum #0124-03: Reproducing Human Evaluations of end-to-end approaches for Referring Expression Generation COLING 2024 ReproHum #0712-01: Human Evaluation Reproduction Report for “Hierarchical Sketch Induction for Paraphrase Generation” COLING 2024 ReproHum #0927-03: DExpert Evaluation? Reproducing Human Judgements of the Fluency of Generated Text COLING 2024 ReproHum #0927-3: Reproducing The Human Evaluation Of The DExperts Controlled Text Generation Method COLING 2024 The 2024 ReproNLP Shared Task on Reproducibility of Evaluations in NLP: Overview and Results COLING 2024 Common Law Annotations: Investigating the Stability of Dialog System Output Annotations ACL 2023 Native Language Prediction from Gaze: a Reproducibility Study ACL 2023