← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

Identifying Statistical Bias in Dataset Replication ICML 2020
On the Value of Out-of-Distribution Testing: An Example of Goodhart's Law NIPS 2020
jiant: A Software Toolkit for Research on General-Purpose Text Understanding Models ACL 2020
Benchmarking the Robustness of Semantic Segmentation Models CVPR 2020
Experimental Evaluation and Development of a Silver-Standard for the MIMIC-III Clinical Coding Dataset ACL 2020
Effects of Naturalistic Variation in Goal-Oriented Dialog EMNLP 2020
Taking a Deeper Look at Co-Salient Object Detection CVPR 2020
WER we are and WER we think we are EMNLP 2020
CLUE: A Chinese Language Understanding Evaluation Benchmark COLING 2020
From ImageNet to Image Classification: Contextualizing Progress on Benchmarks ICML 2020
Adversarial NLI: A New Benchmark for Natural Language Understanding ACL 2020
Adversarial Filters of Dataset Biases ICML 2020
TRENDNERT: A Benchmark for Trend and Downtrend Detection in a Scientific Domain AAAI 2020
TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification EMNLP 2020
Evaluating Machine Accuracy on ImageNet ICML 2020
Let’s Stop Incorrect Comparisons in End-to-end Relation Extraction! EMNLP 2020
Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets AAAI 2020
Evaluating Commonsense in Pre-Trained Language Models AAAI 2020
Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning CORL 2019
EQUATE: A Benchmark Evaluation Framework for Quantitative Reasoning in Natural Language Inference CONLL 2019
Cold Case: The Lost MNIST Digits NIPS 2019
Lost in Evaluation: Misleading Benchmarks for Bilingual Dictionary Induction IJCNLP 2019
How Reasonable are Common-Sense Reasoning Tasks: A Case-Study on the Winograd Schema Challenge and SWAG IJCNLP 2019
Revisiting the Evaluation of Theory of Mind through Question Answering EMNLP 2019
Revisiting the Evaluation of Theory of Mind through Question Answering IJCNLP 2019