benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

MisinfoBench: A Multi-Dimensional Benchmark for Evaluating LLMs’ Resilience to Misinformation EMNLP 2025

HighMATH: Evaluating Math Reasoning of Large Language Models in Breadth and Depth EMNLP 2025

Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM EMNLP 2025

RLMEval: Evaluating Research-Level Neural Theorem Proving EMNLP 2025

CLaw: Benchmarking Chinese Legal Knowledge in Large Language Models - A Fine-grained Corpus and Reasoning Analysis EMNLP 2025

RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing EMNLP 2025

Benchmarking Contextual and Paralinguistic Reasoning in Speech-LLMs: A Case Study with In-the-Wild Data EMNLP 2025

MLAlgo-Bench: Can Machines Implement Machine Learning Algorithms? EMNLP 2025

TRUEBench: Can LLM Response Meet Real-world Constraints as Productivity Assistant? EMNLP 2025

X-LeBench: A Benchmark for Extremely Long Egocentric Video Understanding EMNLP 2025

ULTRABENCH: Benchmarking LLMs under Extreme Fine-grained Text Generation EMNLP 2025

When Instructions Multiply: Measuring and Estimating LLM Capabilities of Multiple Instructions Following EMNLP 2025

EnDive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Models EMNLP 2025

PhysicsArena: The First Multimodal Physics Reasoning Benchmark Exploring Variable, Process, and Solution Dimensions EMNLP 2025

Ko-LongRAG: A Korean Long-Context RAG Benchmark Built with a Retrieval-Free Approach EMNLP 2025

Large Language Model Agents in Finance: A Survey Bridging Research, Practice, and Real-World Deployment EMNLP 2025

Problem Solved? Information Extraction Design Space for Layout-Rich Documents using LLMs EMNLP 2025

LastingBench: Defend Benchmarks Against Knowledge Leakage EMNLP 2025

VisEscape: A Benchmark for Evaluating Exploration-driven Decision-making in Virtual Escape Rooms EMNLP 2025

FlashAdventure: A Benchmark for GUI Agents Solving Full Story Arcs in Diverse Adventure Games EMNLP 2025

Beyond the Haystack: Sensitivity to Context in Legal Reference Recall EMNLP 2025

CausalGraphBench: a Benchmark for Evaluating Language Models capabilities of Causal Graph discovery ACL 2025

LiteraryQA: Towards Effective Evaluation of Long-document Narrative QA EMNLP 2025

R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generation EMNLP 2025

Can LLMs Help You at Work? A Sandbox for Evaluating LLM Agents in Enterprise Environments EMNLP 2025