← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

Compositional Generalization in Dependency Parsing ACL 2022
LogicNMR: Probing the Non-monotonic Reasoning Ability of Pre-trained Language Models EMNLP 2022
What are the best Systems? New Perspectives on NLP Benchmarking NIPS 2022
This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polish NIPS 2022
Findings of the TSAR-2022 Shared Task on Multilingual Lexical Simplification EMNLP 2022
A Fine-grained Interpretability Evaluation Benchmark for Neural NLP EMNLP 2022
BackdoorBench: A Comprehensive Benchmark of Backdoor Learning NIPS 2022
CGLB: Benchmark Tasks for Continual Graph Learning NIPS 2022
Evaluating Out-of-Distribution Performance on Document Image Classifiers NIPS 2022
PaCo: Preconditions Attributed to Commonsense Knowledge EMNLP 2022
Measuring Compositional Consistency for Video Question Answering CVPR 2022
The DEVIL Is in the Details: A Diagnostic Evaluation Benchmark for Video Inpainting CVPR 2022
BLOX: Macro Neural Architecture Search Benchmark and Algorithms NIPS 2022
ADBench: Anomaly Detection Benchmark NIPS 2022
OpenOOD: Benchmarking Generalized Out-of-Distribution Detection NIPS 2022
What’s Different between Visual Question Answering for Machine “Understanding” Versus for Accessibility? AACL 2022
TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media COLING 2022
Challenges in Procedural Multimodal Machine Comprehension: A Novel Way To Benchmark WACV 2022
Grammatical Error Correction: Are We There Yet? COLING 2022
ELEVANT: A Fully Automatic Fine-Grained Entity Linking Evaluation and Analysis Tool EMNLP 2022
MIA 2022 Shared Task: Evaluating Cross-lingual Open-Retrieval Question Answering for 16 Diverse Languages NAACL 2022
CLLE: A Benchmark for Continual Language Learning Evaluation in Multilingual Machine Translation EMNLP 2022
Critical Perspectives: A Benchmark Revealing Pitfalls in PerspectiveAPI EMNLP 2022
Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks NAACL 2022
VLUE: A Multi-Task Multi-Dimension Benchmark for Evaluating Vision-Language Pre-training ICML 2022