← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

TAPE: Assessing Few-shot Russian Language Understanding EMNLP 2022
Revisiting DocRED - Addressing the False Negative Problem in Relation Extraction EMNLP 2022
Oh My Mistake!: Toward Realistic Dialogue State Tracking including Turnback Utterances EMNLP 2022
20Q: Overlap-Free World Knowledge Benchmark for Language Models EMNLP 2022
It Is Not Easy To Detect Paraphrases: Analysing Semantic Similarity With Antonyms and Negation Using the New SemAntoNeg Benchmark EMNLP 2022
Snoopy: An Online Interface for Exploring the Effect of Pretraining Term Frequencies on Few-Shot LM Performance EMNLP 2022
GuoFeng: A Benchmark for Zero Pronoun Recovery and Translation EMNLP 2022
Human-Adversarial Visual Question Answering NIPS 2021
Identifying and Benchmarking Natural Out-of-Context Prediction Problems NIPS 2021
Beyond the Tip of the Iceberg: Assessing Coherence of Text Classifiers EMNLP 2021
Numerical reasoning in machine reading comprehension tasks: are we there yet? EMNLP 2021
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms EMNLP 2021
Is “moby dick” a Whale or a Bird? Named Entities and Terminology in Speech Translation EMNLP 2021
Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy to Game NIPS 2021
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking NIPS 2021
Deep Reinforcement Learning at the Edge of the Statistical Precipice NIPS 2021
Two Sides of Meta-Learning Evaluation: In vs. Out of Distribution NIPS 2021
Diagnosing the First-Order Logical Reasoning Ability Through LogicNLI EMNLP 2021
We Need to Talk About train-dev-test Splits EMNLP 2021
Parameter Selection: Why We Should Pay More Attention to It ACL 2021
The Corpora They Are a-Changing: a Case Study in Italian Newspapers ACL 2021
LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech INTERSPEECH 2021
Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding INTERSPEECH 2021
Rethinking Evaluation in ASR: Are Our Models Robust Enough? INTERSPEECH 2021
E-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks ICCV 2021