← Optimization & Theory
Machine Learning › Optimization & Theory ›

Evaluation

515 directly classified papers

Papers per year

Papers

Never mind the metrics---what about the uncertainty? Visualising binary confusion matrix metric distributions to put performance in perspective ICML 2023
Improved Policy Evaluation for Randomized Trials of Algorithmic Resource Allocation ICML 2023
ModelDiff: A Framework for Comparing Learning Algorithms ICML 2023
Synthetic data for model selection ICML 2023
HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Models ICCV 2023
Range-Based Equal Error Rate for Spoof Localization INTERSPEECH 2023
Ontology-aware Learning and Evaluation for Audio Tagging INTERSPEECH 2023
Investigating Reproducibility at Interspeech Conferences: A Longitudinal and Comparative Perspective INTERSPEECH 2023
Average Token Delay: A Latency Metric for Simultaneous Translation INTERSPEECH 2023
Why We Should Report the Details in Subjective Evaluation of TTS More Rigorously INTERSPEECH 2023
Annotation Sensitivity: Training Data Collection Methods Affect Model Performance EMNLP 2023
Do “English” Named Entity Recognizers Work Well on Global Englishes? EMNLP 2023
Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023? ACL 2023
Do Question Answering Modeling Improvements Hold Across Benchmarks? ACL 2023
Model Analysis & Evaluation for Ambiguous Question Answering ACL 2023
Correction of Errors in Preference Ratings from Automated Metrics for Text Generation ACL 2023
Moving Beyond Downstream Task Accuracy for Information Retrieval Benchmarking ACL 2023
Common Law Annotations: Investigating the Stability of Dialog System Output Annotations ACL 2023
Distinguishing Romanized Hindi from Romanized Urdu ACL 2023
Lenient Evaluation of Japanese Speech Recognition: Modeling Naturally Occurring Spelling Inconsistency ACL 2023
How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey EMNLP 2023
Holistic Inter-Annotator Agreement and Corpus Coherence Estimation in a Large-scale Multilingual Annotation Campaign EMNLP 2023
Influence Scores at Scale for Efficient Language Data Sampling EMNLP 2023
GlobalBench: A Benchmark for Global Progress in Natural Language Processing EMNLP 2023
Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models EMNLP 2023