benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation ACL 2025

AssoCiAm: A Benchmark for Evaluating Association Thinking while Circumventing Ambiguity EMNLP 2025

OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domain EMNLP 2025

QualBench: Benchmarking Chinese LLMs with Localized Professional Qualifications for Vertical Domain Evaluation EMNLP 2025

LMR-BENCH: Evaluating LLM Agent’s Ability on Reproducing Language Modeling Research EMNLP 2025

Audio-centric Video Understanding Benchmark without Text Shortcut EMNLP 2025

PoSum-Bench: Benchmarking Position Bias in LLM-based Conversational Summarization EMNLP 2025

TurnBack: A Geospatial Route Cognition Benchmark for Large Language Models through Reverse Route EMNLP 2025

Can Large Language Models Win the International Mathematical Games? EMNLP 2025

Deriving Strategic Market Insights with Large Language Models: A Benchmark for Forward Counterfactual Generation EMNLP 2025

Examining False Positives under Inference Scaling for Mathematical Reasoning EMNLP 2025

Do You Know About My Nation? Investigating Multilingual Language Models’ Cultural Literacy Through Factual Knowledge EMNLP 2025

M3Retrieve: Benchmarking Multimodal Retrieval for Medicine EMNLP 2025

DyePack: Provably Flagging Test Set Contamination in LLMs Using Backdoors EMNLP 2025

Benchmark Profiling: Mechanistic Diagnosis of LLM Benchmarks EMNLP 2025

WildScore: Benchmarking MLLMs in-the-Wild Symbolic Music Reasoning EMNLP 2025

Why Stop at One Error? Benchmarking LLMs as Data Science Code Debuggers for Multi-Hop and Multi-Bug Errors EMNLP 2025

Temporal Referential Consistency: Do LLMs Favor Sequences Over Absolute Time References? EMNLP 2025

Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios EMNLP 2025

STEER-BENCH: A Benchmark for Evaluating the Steerability of Large Language Models EMNLP 2025

MolErr2Fix: Benchmarking LLM Trustworthiness in Chemistry via Modular Error Detection, Localization, Explanation, and Correction EMNLP 2025

Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs EMNLP 2025

Languages Still Left Behind: Toward a Better Multilingual Machine Translation Benchmark EMNLP 2025

What are Foundation Models Cooking in the Post-Soviet World? EMNLP 2025

Comparative Evaluation of 3D Reconstruction Methods for Object Pose Estimation WACV 2025