← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems NAACL 2025
Are Multimodal LLMs Robust Against Adversarial Perturbations? RoMMath: A Systematic Evaluation on Multimodal Math Reasoning NAACL 2025
FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions NAACL 2025
Reverse Question Answering: Can an LLM Write a Question so Hard (or Bad) that it Can’t Answer? NAACL 2025
ScratchEval: Are GPT-4o Smarter than My Child? Evaluating Large Multimodal Models with Visual Programming Challenges NAACL 2025
IdentifyMe: A Challenging Long-Context Mention Resolution Benchmark for LLMs NAACL 2025
Understanding LLM Development Through Longitudinal Study: Insights from the Open Ko-LLM Leaderboard NAACL 2025
How LLMs React to Industrial Spatio-Temporal Data? Assessing Hallucination with a Novel Traffic Incident Benchmark Dataset NAACL 2025
Towards Reliable Agents: Benchmarking Customized LLM-Based Retrieval-Augmented Generation Frameworks with Deployment Validation NAACL 2025
DateLogicQA: Benchmarking Temporal Biases in Large Language Models NAACL 2025
RewardBench: Evaluating Reward Models for Language Modeling NAACL 2025
Evaluating Vision-Language Models for Emotion Recognition NAACL 2025
CausalGraph2LLM: Evaluating LLMs for Causal Queries NAACL 2025
SciAssess: Benchmarking LLM Proficiency in Scientific Literature Analysis NAACL 2025
Advancing Persian LLM Evaluation NAACL 2025
MIRAGE: A Metric-Intensive Benchmark for Retrieval-Augmented Generation Evaluation NAACL 2025
Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots NAACL 2025
VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMs NAACL 2025
Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publications NAACL 2025
Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkish ACL 2025
Evaluating Multimodal Generative AI with Korean Educational Standards NAACL 2025
ColorFoil: Investigating Color Blindness in Large Vision and Language Models NAACL 2025
Unveiling Cultural Blind Spots: Analyzing the Limitations of mLLMs in Procedural Text Comprehension ACL 2025
Big Escape Benchmark: Evaluating Human-Like Reasoning in Language Models via Real-World Escape Room Challenges ACL 2025
KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual Contexts EMNLP 2025