model evaluation

442 papers

Explore in graph

Co-occurring keywords

large language model (12755) benchmark evaluation (1539) text classification (6776) language model (4573) natural language processing (2027) evaluation benchmark (250) natural language inference (1278) multimodal learning (4622) bias detection (419) transfer learning (5442)

Papers

The Irrationality of Neural Rationale Models NAACL 2022

Supervised and Unsupervised Evaluation of Synthetic Code-Switching COLING 2022

Measure and Improve Robustness in NLP Models: A Survey NAACL 2022

An Investigation of Critical Issues in Bias Mitigation Techniques WACV 2022

When AUC meets DRO: Optimizing Partial AUC for Deep Learning with Non-Convex Convergence Guarantee ICML 2022

SHAPE: An Unified Approach to Evaluate the Contribution and Cooperation of Individual Modalities IJCAI 2022

When AI Difficulty Is Easy: The Explanatory Power of Predicting IRT Difficulty AAAI 2022

The King Is Naked: On the Notion of Robustness for Natural Language Processing AAAI 2022

Text Characterization Toolkit (TCT) AACL 2022

Hard and Soft Evaluation of NLP models with BOOtSTrap SAmpling - BooStSa ACL 2022

Mandoline: Model Evaluation under Distribution Shift ICML 2021

SyMetric: Measuring the Quality of Learnt Hamiltonian Dynamics Inferred from Vision NIPS 2021

Themis: A Fair Evaluation Platform for Computer Vision Competitions IJCAI 2021

Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models ACL 2021

Memorization vs. Generalization : Quantifying Data Leakage in NLP Performance Evaluation EACL 2021

CrossCheck: Rapid, Reproducible, and Interpretable Model Evaluation NAACL 2021

Topic Model or Topic Twaddle? Re-evaluating Semantic Interpretability Measures NAACL 2021

Evaluating Deception Detection Model Robustness To Linguistic Variation NAACL 2021

Choose Your Own Adventure: Paired Suggestions in Collaborative Writing for Evaluating Story Generation Models NAACL 2021

Using Adversarial Attacks to Reveal the Statistical Bias in Machine Reading Comprehension Models ACL 2021

Are NLP Models really able to Solve Simple Math Word Problems? NAACL 2021

HateCheck: Functional Tests for Hate Speech Detection Models IJCNLP 2021

Are Labels Always Necessary for Classifier Accuracy Evaluation? CVPR 2021

Beyond the Tip of the Iceberg: Assessing Coherence of Text Classifiers EMNLP 2021

Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards? IJCNLP 2021