← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

Bridging the Gap between Reality and Ideality of Entity Matching: A Revisiting and Benchmark Re-Construction IJCAI 2022
XTREME-S: Evaluating Cross-lingual Speech Representations INTERSPEECH 2022
Towards a Rigorous Evaluation of Time-Series Anomaly Detection AAAI 2022
LILA: A Unified Benchmark for Mathematical Reasoning EMNLP 2022
The Paradox of the Compositionality of Natural Language: A Neural Machine Translation Case Study ACL 2022
Efficient Classification of Long Documents Using Transformers ACL 2022
MetaLogic: Logical Reasoning Explanations with Fine-Grained Structure EMNLP 2022
Clustering Examples in Multi-Dataset Benchmarks with Item Response Theory ACL 2022
Generative Language Models for Paragraph-Level Question Generation EMNLP 2022
OpenXAI: Towards a Transparent Evaluation of Model Explanations NIPS 2022
Towards a Standardised Performance Evaluation Protocol for Cooperative MARL NIPS 2022
Beyond Real-world Benchmark Datasets: An Empirical Study of Node Classification with GNNs NIPS 2022
What’s Different between Visual Question Answering for Machine “Understanding” Versus for Accessibility? IJCNLP 2022
MiQA: A Benchmark for Inference on Metaphorical Questions IJCNLP 2022
Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification NAACL 2022
DC-BENCH: Dataset Condensation Benchmark NIPS 2022
On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models? NAACL 2022
QuALITY: Question Answering with Long Input Texts, Yes! NAACL 2022
BECEL: Benchmark for Consistency Evaluation of Language Models COLING 2022
SimVP: Simpler Yet Better Video Prediction CVPR 2022
What Makes Reading Comprehension Questions Difficult? ACL 2022
VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena ACL 2022
Ditch the Gold Standard: Re-evaluating Conversational Question Answering ACL 2022
Sample Efficiency Matters: A Benchmark for Practical Molecular Optimization NIPS 2022
On the Limits of Evaluating Embodied Agent Model Generalization Using Validation Sets ACL 2022