conftrace_

statistical evaluation

15 papers

Explore in graph

Co-occurring keywords

human evaluation (379) large language model (13587) statistical analysis (89) empirical distribution (9) evaluation metric (573) cognitive bia (46) annotation quality (109) randomized control trial (2) classifier comparison (10) treatment allocation (4)

Papers

Evaluating Index-based Treatment Allocation in Underresourced Communities AAAI 2025
A Monte-Carlo Sampling Framework For Reliable Evaluation of Large Language Models Using Behavioral Analysis EMNLP 2025
Ranger: A Toolkit for Effect-Size Based Multi-Task Evaluation ACL 2023
MOS vs. AB: Evaluating Text-to-Speech Systems Reliably Using Clustered Standard Errors INTERSPEECH 2023
$p$-value Adjustment for Monotonous, Unbiased, and Fast Clustering Comparison NIPS 2023
Statistical Knowledge Assessment for Large Language Models NIPS 2023
Deep Reinforcement Learning at the Edge of the Statistical Precipice NIPS 2021
Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability ACL 2021
Item Response Theory for Efficient Human Evaluation of Chatbots EMNLP 2020
Is the Best Better? Bayesian Statistical Model Comparison for Natural Language Processing EMNLP 2020
Unifying Human and Statistical Evaluation for Natural Language Generation NAACL 2019
Machine Assisted Analysis of Vowel Length Contrasts in Wolof INTERSPEECH 2017
Time for a Change: a Tutorial for Comparing Multiple Classifiers Through Bayesian Analysis JMLR 2017
Efficient Illuminant Estimation for Color Constancy Using Grey Pixels CVPR 2015
On Bootstrapping the ROC Curve NIPS 2008