Co-occurring keywords · papers mentioning both
Papers
Beyond statistical significance: Quantifying uncertainty and statistical variability in multilingual and multitask NLP evaluation
IJCNLP 2025
Chip Placement with Diffusion Models
ICML 2025
CIC-NLP at GenAI Detection Task 1: Advancing Multilingual Machine-Generated Text Detection
COLING 2025
MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Models
EMNLP 2025
Measuring Visual Understanding in Telecom domain: Performance Metrics for Image-to-UML conversion using VLMs
AACL 2025
Beyond the Numbers: Transparency in Relation Extraction Benchmark Creation and Leaderboards
EMNLP 2024
Consistent Multiclass Algorithms for Complex Metrics and Constraints
JMLR 2024
Granular Change Accuracy: A More Accurate Performance Metric for Dialogue State Tracking
COLING 2024
MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Models
MIDL 2024
Revealing Confounding Biases: A Novel Benchmarking Approach for Aggregate-Level Performance Metrics in Health Assessments
Interspeech 2024
Weak Supervision Performance Evaluation via Partial Identification
NeurIPS 2024
Cooperative Inverse Decision Theory for Uncertain Preferences
AISTATS 2023
Demonstrating Mobile Manipulation in the Wild: A Metrics-Driven Approach
RSS 2023
Never mind the metrics---what about the uncertainty? Visualising binary confusion matrix metric distributions to put performance in perspective
ICML 2023
What are the best Systems? New Perspectives on NLP Benchmarking
NeurIPS 2022
Benchmarking: Past, Present and Future
ACL 2021
AUCμ: A Performance Metric for Multi-Class Machine Learning Models
ICML 2019
Multiclass Performance Metric Elicitation
NeurIPS 2019
ORCA: A Matlab/Octave Toolbox for Ordinal Regression
JMLR 2019
Report of NEWS 2018 Named Entity Transliteration Shared Task
ACL 2018
Vesper: Measuring Time-to-Interactivity for Web Pages
NSDI 2018
Surrogate regret bounds for generalized classification performance metrics
ACML 2015
Consistent Binary Classification with Generalized Performance Metrics
NeurIPS 2014
Empirical performance maximization for linear rank statistics
NeurIPS 2008