benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

DI-BENCH: Benchmarking Large Language Models on Dependency Inference with Testable Repositories at Scale ACL 2025

TeXpert: A Multi-Level Benchmark for Evaluating LaTeX Code Generation by LLMs ACL 2025

Stress-Testing Multimodal Foundation Models for Crystallographic Reasoning ACL 2025

MMVU: Measuring Expert-Level Multi-Discipline Video Understanding CVPR 2025

NovPhy: A Physical Reasoning Benchmark for Open-World AI Systems Author Links Open Overlay Panel (Abstract Reprint) IJCAI 2025

A-I-RAVEN and I-RAVEN-Mesh: Two New Benchmarks for Abstract Visual Reasoning IJCAI 2025

Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Models IJCAI 2025

ECBench: Can Multi-modal Foundation Models Understand the Egocentric World? A Holistic Embodied Cognition Benchmark CVPR 2025

TTT-Bench: A Benchmark for Evaluating Reasoning Ability with Simple and Novel Tic-Tac-Toe-style Games EMNLP 2025

IberoBench: A Benchmark for LLM Evaluation in Iberian Languages COLING 2025

How Do Multimodal Large Language Models Handle Complex Multimodal Reasoning? Placing Them in An Extensible Escape Game ICCV 2025

3DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark ICCV 2025

MMCR: Benchmarking Cross-Source Reasoning in Scientific Papers ICCV 2025

Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLMs ICCV 2025

Towards Video Thinking Test: A Holistic Benchmark for Advanced Video Reasoning and Understanding ICCV 2025

VLRMBench: A Comprehensive and Challenging Benchmark for Vision-Language Reward Models ICCV 2025

SITE: towards Spatial Intelligence Thorough Evaluation ICCV 2025

Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data and Metric Perspectives ICCV 2025

FinMMR: Make Financial Numerical Reasoning More Multimodal, Comprehensive, and Challenging ICCV 2025

ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editing ICCV 2025

Where Are We? Evaluating LLM Performance on African Languages ACL 2025

UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces ACL 2025

VC4VG: Optimizing Video Captions for Text-to-Video Generation EMNLP 2025

Ref-Long: Benchmarking the Long-context Referencing Capability of Long-context Language Models ACL 2025

In Benchmarks We Trust ... Or Not? EMNLP 2025