conftrace_

evaluation methodology

109 papers

Explore in graph

Co-occurring keywords

benchmark evaluation (1556) large language model (13587) human evaluation (379) machine translation (2499) natural language processing (2034) model evaluation (445) evaluation metric (573) machine learning (436) benchmark dataset (635) evaluation benchmark (257)

Papers

How Good (really) are Grammatical Error Correction Systems? EACL 2021
Realistic Evaluation Principles for Cross-document Coreference Resolution IJCNLP 2021
Realistic Evaluation Principles for Cross-document Coreference Resolution ACL 2021
Benchmarking: Past, Present and Future IJCNLP 2021
Towards the evaluation of automatic simultaneous speech translation from a communicative perspective IJCNLP 2021
We Need To Talk About Random Splits EACL 2021
Let’s Stop Incorrect Comparisons in End-to-end Relation Extraction! EMNLP 2020
If You Build Your Own NER Scorer, Non-replicable Results Will Come EMNLP 2020
Would you describe a leopard as yellow? Evaluating crowd-annotations with justified and informative disagreement COLING 2020
Evaluating the Performance of Reinforcement Learning Algorithms ICML 2020
On Importance Sampling-Based Evaluation of Latent Language Models ACL 2020
An Evaluation Method for Diachronic Word Sense Induction EMNLP 2020
Fine-Grained Evaluation for Entity Linking EMNLP 2019
We Need to Talk about Standard Splits ACL 2019
Bias Analysis and Mitigation in the Evaluation of Authorship Verification ACL 2019
Pitfalls in the Evaluation of Sentence Embeddings ACL 2019
Rethinking the Evaluation of Video Summaries CVPR 2019
Re-evaluating evaluation NIPS 2018
A Methodology for Evaluating Interaction Strategies of Task-Oriented Conversational Agents EMNLP 2018
Deep learning evaluation using deep linguistic processing NAACL 2018
Coming to Your Senses: on Controls and Evaluation Sets in Polysemy Research EMNLP 2018
Improving Text-to-SQL Evaluation Methodology ACL 2018
Evaluating Multiple System Summary Lengths: A Case Study EMNLP 2018
The Word Analogy Testing Caveat NAACL 2018
The Hitchhiker’s Guide to Testing Statistical Significance in Natural Language Processing ACL 2018