model evaluation

ROME: Evaluating Pre-trained Vision-Language Models on Reasoning beyond Visual Common Sense EMNLP 2023 Statistically Profiling Biases in Natural Language Reasoning Datasets and Models EMNLP 2023 The Larger they are, the Harder they Fail: Language Models do not Recognize Identifier Swaps in Python ACL 2023 The OPUS-MT Dashboard – A Toolkit for a Systematic Evaluation of Open Machine Translation Models ACL 2023 The Self-Contained Negation Test Set EMNLP 2023 Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies ICML 2023 What are the Desired Characteristics of Calibration Sets? Identifying Correlates on Long Form Scientific Summarization ACL 2023 Active Surrogate Estimators: An Active Learning Approach to Label-Efficient Model Evaluation NeurIPS 2022 Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair NAACL 2022 Analyzing and Evaluating Faithfulness in Dialogue Summarization EMNLP 2022 An Explainable Toolbox for Evaluating Pre-trained Vision-Language Models EMNLP 2022 An Investigation of Critical Issues in Bias Mitigation Techniques WACV 2022 Are Pretrained Multilingual Models Equally Fair across Languages? COLING 2022 Assessment of Massively Multilingual Sentiment Classifiers ACL 2022 Azimuth: Systematic Error Analysis for Text Classification EMNLP 2022 BBQ: A hand-built bias benchmark for question answering ACL 2022 Can Machines Read Coding Manuals Yet? – A Benchmark for Building Better Language Models for Code Understanding AAAI 2022 Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View ACL 2022 Digging Errors in NMT: Evaluating and Understanding Model Errors from Partial Hypothesis Space EMNLP 2022 Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks ACL 2022 ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models NAACL 2022 Enabling Detailed Action Recognition Evaluation Through Video Dataset Augmentation NeurIPS 2022 Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements EMNLP 2022 Evaluation of Response Generation Models: Shouldn’t It Be Shareable and Replicable? EMNLP 2022 Execution-based Evaluation for Data Science Code Generation Models EMNLP 2022