← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

Unveiling the Ignorance of MLLMs: Seeing Clearly, Answering Incorrectly CVPR 2025
Mind the Gap: Static and Interactive Evaluations of Large Audio Models ACL 2025
ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs’ Capability via Chart Editing ACL 2025
MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarios ACL 2025
Firm or Fickle? Evaluating Large Language Models Consistency in Sequential Interactions ACL 2025
XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoning ACL 2025
PII-Scope: A Comprehensive Study on Training Data Privacy Leakage in Pretrained LLMs AACL 2025
FarSense: A Comprehensive Commonsense Benchmark and Evaluation Framework for the Farsi Language AACL 2025
OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts CVPR 2025
VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation CVPR 2025
MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents ACL 2025
Probing the Mid-level Vision Capabilities of Self-Supervised Learning CVPR 2025
CodeIF: Benchmarking the Instruction-Following Capabilities of Large Language Models for Code Generation ACL 2025
Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs ACL 2025
KRISTEVA: Close Reading as a Novel Task for Benchmarking Interpretive Reasoning ACL 2025
How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts? EMNLP 2025
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs ACL 2025
Where Are We? Evaluating LLM Performance on African Languages ACL 2025
Reasoning Models Reason Well, Until They Don’t AACL 2025
ReasoningWeekly: A General Knowledge and Verbal Reasoning Challenge for Large Language Models AACL 2025
RCI: A Score for Evaluating Global and Local Reasoning in Multimodal Benchmarks EMNLP 2025
Assessing the Macro and Micro Effects of Random Seeds on Fine-Tuning Large Language Models AACL 2025
EducationQ: Evaluating LLMs’ Teaching Capabilities Through Multi-Agent Dialogue Framework ACL 2025
Visual Robustness Benchmark for Visual Question Answering (VQA) WACV 2025
FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation ACL 2025