conftrace_

model comparison

51 papers

Explore in graph

Co-occurring keywords

benchmark evaluation (1556) large language model (13587) language model (4599) language model evaluation (227) model evaluation (445) evaluation methodology (109) prompt engineering (1135) text classification (6793) bayesian inference (1907) transfer learning (5449)

Papers

The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation ACL 2023
On “Scientific Debt” in NLP: A Case for More Rigour in Language Model Pre-Training Research ACL 2023
Follow the leader(board) with confidence: Estimating p-values from a single test set with item and response variance ACL 2023
Do Question Answering Modeling Improvements Hold Across Benchmarks? ACL 2023
HAPI: A Large-scale Longitudinal Dataset of Commercial ML API Predictions NIPS 2022
JBNU-CCLab at SemEval-2022 Task 7: DeBERTa for Identifying Plausible Clarifications in Instructional Texts NAACL 2022
Pythae: Unifying Generative Autoencoders in Python - A Benchmarking Use Case NIPS 2022
Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets EMNLP 2022
Are Pretrained Convolutions Better than Pretrained Transformers? ACL 2021
What Changed? Interpretable Model Comparison IJCAI 2021
Team 9: A Comparison of Simple vs. Complex Models for Suicide Risk Assessment NAACL 2021
Comparing Symbolic Models of Language via Bayesian Inference (Student Abstract) AAAI 2021
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking NIPS 2021
Beyond accuracy: quantifying trial-by-trial behaviour of CNNs and humans by measuring error consistency NIPS 2020
Let’s Stop Incorrect Comparisons in End-to-end Relation Extraction! EMNLP 2020
Show Your Work: Improved Reporting of Experimental Results EMNLP 2019
Kernel Stein Tests for Multiple Model Comparison NIPS 2019
Deep Dominance - How to Properly Compare Deep Neural Models ACL 2019
Comparing Sample-Wise Learnability across Deep Neural Network Models AAAI 2019
What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysis ICCV 2019
Informative Features for Model Comparison NIPS 2018
Human vs. Computer in Scene and Object Recognition CVPR 2014
Active Comparison of Prediction Models NIPS 2012
A Bayesian Approach to Concept Drift NIPS 2010
Bayesian Sparse Factor Models and DAGs Inference and Comparison NIPS 2009