evaluation methodology

The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation ACL 2023 The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks CoNLL 2023 Why We Should Report the Details in Subjective Evaluation of TTS More Rigorously Interspeech 2023 Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand NAACL 2022 ILDAE: Instance-Level Difficulty Analysis of Evaluation Data ACL 2022 Impact of Evaluation Methodologies on Code Summarization ACL 2022 Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics ACL 2022 Non-Autoregressive Machine Translation: It’s Not as Fast as it Seems NAACL 2022 Non-Semantic Evaluation of Image Forensics Tools: Methodology and Database WACV 2022 On the Use of Unrealistic Predictions in Hundreds of Papers Evaluating Graph Representations AAAI 2022 Quantified Reproducibility Assessment of NLP Results ACL 2022 Revisiting Parameter-Efficient Tuning: Are We Really There Yet? EMNLP 2022 The Human Evaluation Datasheet: A Template for Recording Details of Human Evaluation Experiments in NLP ACL 2022 The patient is more dead than alive: exploring the current state of the multi-document summarisation of the biomedical literature ACL 2022 Towards a Standardised Performance Evaluation Protocol for Cooperative MARL NeurIPS 2022 Benchmarking: Past, Present and Future ACL 2021 Flamingos and Hedgehogs in the Croquet-Ground: Teaching Evaluation of NLP Systems for Undergraduate Students NAACL 2021 How Good (really) are Grammatical Error Correction Systems? EACL 2021 Methods for the Design and Evaluation of HCI+NLP Systems EACL 2021 Pushing the Right Buttons: Adversarial Evaluation of Quality Estimation EMNLP 2021 Realistic Evaluation Principles for Cross-document Coreference Resolution ACL 2021 Semantics Altering Modifications for Evaluating Comprehension in Machine Reading AAAI 2021 The Great Misalignment Problem in Human Evaluation of NLP Methods EACL 2021 Towards a more Robust Evaluation for Conversational Question Answering ACL 2021 We Need To Talk About Random Splits EACL 2021