conftrace_

evaluation methodology

109 papers

Explore in graph

Co-occurring keywords

benchmark evaluation (1556) large language model (13587) human evaluation (379) machine translation (2499) natural language processing (2034) model evaluation (445) evaluation metric (573) machine learning (436) benchmark dataset (635) evaluation benchmark (257)

Papers

The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks CONLL 2023
Evaluation for Change ACL 2023
Morphological Inflection: A Reality Check ACL 2023
On Degrees of Freedom in Defining and Testing Natural Language Understanding ACL 2023
On the Use of Unrealistic Predictions in Hundreds of Papers Evaluating Graph Representations AAAI 2022
Non-Autoregressive Machine Translation: It’s Not as Fast as it Seems NAACL 2022
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand NAACL 2022
Impact of Evaluation Methodologies on Code Summarization ACL 2022
ILDAE: Instance-Level Difficulty Analysis of Evaluation Data ACL 2022
Non-Semantic Evaluation of Image Forensics Tools: Methodology and Database WACV 2022
The patient is more dead than alive: exploring the current state of the multi-document summarisation of the biomedical literature ACL 2022
Revisiting Parameter-Efficient Tuning: Are We Really There Yet? EMNLP 2022
Towards a Standardised Performance Evaluation Protocol for Cooperative MARL NIPS 2022
Quantified Reproducibility Assessment of NLP Results ACL 2022
Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics ACL 2022
The Human Evaluation Datasheet: A Template for Recording Details of Human Evaluation Experiments in NLP ACL 2022
Flamingos and Hedgehogs in the Croquet-Ground: Teaching Evaluation of NLP Systems for Undergraduate Students NAACL 2021
Benchmarking: Past, Present and Future ACL 2021
Semantics Altering Modifications for Evaluating Comprehension in Machine Reading AAAI 2021
A Review of Human Evaluation for Style Transfer IJCNLP 2021
The Great Misalignment Problem in Human Evaluation of NLP Methods EACL 2021
Methods for the Design and Evaluation of HCI+NLP Systems EACL 2021
Towards a more Robust Evaluation for Conversational Question Answering ACL 2021
We Need to Talk About train-dev-test Splits EMNLP 2021
Pushing the Right Buttons: Adversarial Evaluation of Quality Estimation EMNLP 2021