conftrace_

performance metric

24 papers

Explore in graph

Co-occurring keywords

binary classification (678) benchmark evaluation (1556) performance evaluation (53) evaluation metric (573) multilingual evaluation (104) natural language processing (2034) area under curve (15) machine learning (436) surrogate loss (94) confusion matrix (32)

Papers

Measuring Visual Understanding in Telecom domain: Performance Metrics for Image-to-UML conversion using VLMs AACL 2025
CIC-NLP at GenAI Detection Task 1: Advancing Multilingual Machine-Generated Text Detection COLING 2025
Beyond statistical significance: Quantifying uncertainty and statistical variability in multilingual and multitask NLP evaluation IJCNLP 2025
MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Models EMNLP 2025
Measuring Visual Understanding in Telecom domain: Performance Metrics for Image-to-UML conversion using VLMs IJCNLP 2025
Weak Supervision Performance Evaluation via Partial Identification NIPS 2024
Consistent Multiclass Algorithms for Complex Metrics and Constraints JMLR 2024
Revealing Confounding Biases: A Novel Benchmarking Approach for Aggregate-Level Performance Metrics in Health Assessments INTERSPEECH 2024
Beyond the Numbers: Transparency in Relation Extraction Benchmark Creation and Leaderboards EMNLP 2024
Granular Change Accuracy: A More Accurate Performance Metric for Dialogue State Tracking COLING 2024
Never mind the metrics---what about the uncertainty? Visualising binary confusion matrix metric distributions to put performance in perspective ICML 2023
Demonstrating Mobile Manipulation in the Wild: A Metrics-Driven Approach RSS 2023
Cooperative Inverse Decision Theory for Uncertain Preferences AISTATS 2023
What are the best Systems? New Perspectives on NLP Benchmarking NIPS 2022
Benchmarking: Past, Present and Future IJCNLP 2021
Benchmarking: Past, Present and Future ACL 2021
Multiclass Performance Metric Elicitation NIPS 2019
AUCμ: A Performance Metric for Multi-Class Machine Learning Models ICML 2019
ORCA: A Matlab/Octave Toolbox for Ordinal Regression JMLR 2019
Vesper: Measuring Time-to-Interactivity for Web Pages NSDI 2018
Report of NEWS 2018 Named Entity Transliteration Shared Task ACL 2018
Surrogate regret bounds for generalized classification performance metrics ACML 2015
Consistent Binary Classification with Generalized Performance Metrics NIPS 2014
Empirical performance maximization for linear rank statistics NIPS 2008