← Optimization & Theory
Machine Learning › Optimization & Theory ›

Evaluation

515 directly classified papers

Papers per year

Papers

What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments? ICML 2021
Towards the evaluation of automatic simultaneous speech translation from a communicative perspective ACL 2021
Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets EACL 2021
How Good (really) are Grammatical Error Correction Systems? EACL 2021
Evaluating Evaluation Measures for Ordinal Classification and Ordinal Quantification IJCNLP 2021
Better than Average: Paired Evaluation of NLP systems IJCNLP 2021
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics NAACL 2021
Accountable Error Characterization NAACL 2021
Learning Curves for Analysis of Deep Networks ICML 2021
Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding INTERSPEECH 2021
Proxy Indicators for the Quality of Open-domain Dialogues EMNLP 2021
The Acceptability Delta Criterion: Testing Knowledge of Language using the Gradience of Sentence Acceptability EMNLP 2021
Error-Sensitive Evaluation for Ordinal Target Variables EMNLP 2021
What is SemEval evaluating? A Systematic Analysis of Evaluation Campaigns in NLP EMNLP 2021
Troubleshooting Blind Image Quality Models in the Wild CVPR 2021
On Estimating Recommendation Evaluation Metrics under Sampling AAAI 2021
Simpson's Bias in NLP Training AAAI 2021
Better than Average: Paired Evaluation of NLP systems ACL 2021
Evaluating Evaluation Measures for Ordinal Classification and Ordinal Quantification ACL 2021
Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards? ACL 2021
The statistical advantage of automatic NLG metrics at the system level ACL 2021
ExplainaBoard: An Explainable Leaderboard for NLP ACL 2021
We Need to Talk About train-dev-test Splits EMNLP 2021
Assessing the Reliability of Word Embedding Gender Bias Measures EMNLP 2021
Stream-level Latency Evaluation for Simultaneous Machine Translation EMNLP 2021