← Optimization & Theory
Machine Learning › Optimization & Theory ›

Evaluation

515 directly classified papers

Papers per year

Papers

The CLRS Algorithmic Reasoning Benchmark ICML 2022
BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation NAACL 2022
Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics ACL 2022
Transparent Human Evaluation for Image Captioning NAACL 2022
[RETRACTED] NLG-Metricverse: An End-to-End Library for Evaluating Natural Language Generation COLING 2022
Rethinking Knowledge Graph Evaluation Under the Open-World Assumption NIPS 2022
The Change that Matters in Discourse Parsing: Estimating the Impact of Domain Shift on Parser Error ACL 2022
Modeling the Machine Learning Multiverse NIPS 2022
NeoRL: A Near Real-World Benchmark for Offline Reinforcement Learning NIPS 2022
Calibration Error for Heterogeneous Treatment Effects AISTATS 2022
OpenAUC: Towards AUC-Oriented Open-Set Recognition NIPS 2022
Benchopt: Reproducible, efficient and collaborative optimization benchmarks NIPS 2022
What are the best Systems? New Perspectives on NLP Benchmarking NIPS 2022
On Scalable Testing of Samplers NIPS 2022
Identifying Weaknesses in Machine Translation Metrics Through Minimum Bayes Risk Decoding: A Case Study for COMET AACL 2022
Semantic Shift Stability: Efficient Way to Detect Performance Degradation of Word Embeddings and Pre-trained Language Models AACL 2022
Accounting for Language Effect in the Evaluation of Cross-lingual AMR Parsers COLING 2022
Subject Verb Agreement Error Patterns in Meaningless Sentences: Humans vs. BERT COLING 2022
DialSummEval: Revisiting Summarization Evaluation for Dialogues NAACL 2022
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries NAACL 2022
Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification NAACL 2022
SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative Sampling NAACL 2022
Does Summary Evaluation Survive Translation to Other Languages? NAACL 2022
Non-Autoregressive Machine Translation: It’s Not as Fast as it Seems NAACL 2022
Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications NAACL 2022