benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniques IJCAI 2021

Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers ICML 2021

Just How Toxic is Data Poisoning? A Unified Benchmark for Backdoor and Data Poisoning Attacks ICML 2021

How Might We Create Better Benchmarks for Speech Recognition? IJCNLP 2021

Revisiting Rainbow: Promoting more insightful and inclusive deep reinforcement learning research ICML 2021

Benchmarking: Past, Present and Future IJCNLP 2021

Targeting the Benchmark: On Methodology in Current Natural Language Processing Research IJCNLP 2021

Parameter Selection: Why We Should Pay More Attention to It IJCNLP 2021

DiaLex: A Benchmark for Evaluating Multidialectal Arabic Word Embeddings EACL 2021

We Need To Talk About Random Splits EACL 2021

What Will it Take to Fix Benchmarking in Natural Language Understanding? NAACL 2021

Characterizing Generalization under Out-Of-Distribution Shifts in Deep Metric Learning NIPS 2021

Methods for the Design and Evaluation of HCI+NLP Systems EACL 2021

BREEDS: Benchmarks for Subpopulation Shift ICLR 2021

Trafilatura: A Web Scraping Library and Command-Line Tool for Text Discovery and Extraction ACL 2021

Benchmarking: Past, Present and Future ACL 2021

On the Limits of Pseudo Ground Truth in Visual Camera Re-Localisation ICCV 2021

Are NLP Models really able to Solve Simple Math Word Problems? NAACL 2021

Developing a Benchmark for Reducing Data Bias in Authorship Attribution EMNLP 2021

Shortcutted Commonsense: Data Spuriousness in Deep Learning of Commonsense Reasoning EMNLP 2021

Concept Generalization in Visual Representation Learning ICCV 2021

Towards Benchmarking the Utility of Explanations for Model Debugging NAACL 2021

Memes in the Wild: Assessing the Generalizability of the Hateful Memes Challenge Dataset IJCNLP 2021

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation ICML 2020

Span Model for Open Information Extraction on Accurate Corpus AAAI 2020