← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset NIPS 2024
Towards Heterogeneous Long-tailed Learning: Benchmarking, Metrics, and Toolbox NIPS 2024
DocMath-Eval: Evaluating Math Reasoning Capabilities of LLMs in Understanding Long and Specialized Documents ACL 2024
EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential Reasoning EMNLP 2024
The Base-Rate Effect on LLM Benchmark Performance: Disambiguating Test-Taking Strategies from Benchmark Performance EMNLP 2024
CLEAN–EVAL: Clean Evaluation on Contaminated Large Language Models NAACL 2024
ProLex: A Benchmark for Language Proficiency-oriented Lexical Substitution ACL 2024
MuLan: A Study of Fact Mutability in Language Models NAACL 2024
BIGOS V2 Benchmark for Polish ASR: Curated Datasets and Tools for Reproducible Evaluation NIPS 2024
INTERSPEECH 2009 Emotion Challenge Revisited: Benchmarking 15 Years of Progress in Speech Emotion Recognition INTERSPEECH 2024
BUST: Benchmark for the evaluation of detectors of LLM-Generated Text NAACL 2024
LOVA3: Learning to Visual Question Answering, Asking and Assessment NIPS 2024
Can LLM Graph Reasoning Generalize beyond Pattern Memorization? EMNLP 2024
Privacy Evaluation Benchmarks for NLP Models EMNLP 2024
Parallel Empirical Evaluations: Resilience despite Concurrency AAAI 2024
Understanding and Mitigating Language Confusion in LLMs EMNLP 2024
M5 – A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks EMNLP 2024
MedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Models AAAI 2024
Benchmarking Large Language Models in Retrieval-Augmented Generation AAAI 2024
Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation AAAI 2024
Can Large Language Models Understand Real-World Complex Instructions? AAAI 2024
Advancing Spatial Reasoning in Large Language Models: An In-Depth Evaluation and Enhancement Using the StepGame Benchmark AAAI 2024
Benchmarking PtO and PnO Methods in the Predictive Combinatorial Optimization Regime NIPS 2024
MR-Ben: A Meta-Reasoning Benchmark for Evaluating System-2 Thinking in LLMs NIPS 2024
Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts EMNLP 2024