conftrace_

statistical significance

26 papers

Explore in graph

Co-occurring keywords

hypothesis testing (254) evaluation metric (573) machine translation (2499) confidence interval (146) human evaluation (379) selective inference (20) pairwise accuracy (4) statistical uncertainty (3) segment-level analysis (4) performance evaluation (53)

Papers

Beyond statistical significance: Quantifying uncertainty and statistical variability in multilingual and multitask NLP evaluation IJCNLP 2025
Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy EMNLP 2024
BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices NIPS 2024
Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies ACL 2024
Estimating the Replication Probability of Significant Classification Benchmark Experiments JMLR 2024
Derandomized novelty detection with FDR control via conformal e-values NIPS 2023
GNAT: A General Narrative Alignment Tool EMNLP 2023
On the Interpretability and Significance of Bias Metrics in Texts: a PMI-based Approach ACL 2023
Differentially Describing Groups of Graphs AAAI 2022
Fast and More Powerful Selective Inference for Sparse High-Order Interaction Model AAAI 2022
Quantifying Statistical Significance of Neural Network-based Image Segmentation by Selective Inference NIPS 2022
Reproducibility Signals in Science: A preliminary analysis AACL 2022
On the Effectiveness of Automated Metrics for Text Generation Systems EMNLP 2022
Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers ACL 2021
MT-Telescope: An interactive platform for contrastive evaluation of MT systems IJCNLP 2021
Confidence Intervals for ASR-Based TTS Evaluation INTERSPEECH 2021
MT-Telescope: An interactive platform for contrastive evaluation of MT systems ACL 2021
NLPStatTest: A Toolkit for Comparing NLP System Performance AACL 2020
Significance Tests for Neural Networks JMLR 2020
Efficiently Enumerating Substrings with Statistically Significant Frequencies of Locally Optimal Occurrences in Gigantic String AAAI 2020
Finding Statistically Significant Interactions between Continuous Features IJCAI 2019
The Hitchhiker’s Guide to Testing Statistical Significance in Natural Language Processing ACL 2018
Significance-based community detection in weighted networks JMLR 2018
Bias and Statistical Significance in Evaluating Speech Synthesis with Mean Opinion Scores INTERSPEECH 2017
Reporting Score Distributions Makes a Difference: Performance Study of LSTM-networks for Sequence Tagging EMNLP 2017