← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

On the Consistency of Commonsense in Large Language Models ACL 2025
M3Retrieve: Benchmarking Multimodal Retrieval for Medicine EMNLP 2025
MUSTS: MUltilingual Semantic Textual Similarity Benchmark ACL 2025
DyePack: Provably Flagging Test Set Contamination in LLMs Using Backdoors EMNLP 2025
ExpliCa: Evaluating Explicit Causal Reasoning in Large Language Models ACL 2025
Arena-lite: Efficient and Reliable Large Language Model Evaluation via Tournament-Based Direct Comparisons EMNLP 2025
PSET: a Phonetics-Semantics Evaluation Testbed EMNLP 2025
FB-Bench: A Fine-Grained Multi-Task Benchmark for Evaluating LLMs’ Responsiveness to Human Feedback EMNLP 2025
CodeArena: Evaluating and Aligning CodeLLMs on Human Preference EMNLP 2025
Benchmarking Large Language Models Under Data Contamination: A Survey from Static to Dynamic Evaluation EMNLP 2025
Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Models EMNLP 2025
How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmark EMNLP 2025
Unmasking Deceptive Visuals: Benchmarking Multimodal Large Language Models on Misleading Chart Question Answering EMNLP 2025
ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledge EMNLP 2025
Do Large Language Models excel in Complex Logical Reasoning with Formal Language? EMNLP 2025
Incorporating Diverse Perspectives in Cultural Alignment: Survey of Evaluation Benchmarks Through A Three-Dimensional Framework EMNLP 2025
MR. Judge: Multimodal Reasoner as a Judge EMNLP 2025
Forget What You Know about LLMs Evaluations - LLMs are Like a Chameleon EMNLP 2025
ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts EMNLP 2025
Hanfu-Bench: A Multimodal Benchmark on Cross-Temporal Cultural Understanding and Transcreation EMNLP 2025
CMedCalc-Bench: A Fine-Grained Benchmark for Chinese Medical Calculations in LLM EMNLP 2025
Jigsaw-Puzzles: From Seeing to Understanding to Reasoning in Vision-Language Models EMNLP 2025
OpenTuringBench: An Open-Model-based Benchmark and Framework for Machine-Generated Text Detection and Attribution EMNLP 2025
CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarios EMNLP 2025
Agri-CM3: A Chinese Massive Multi-modal, Multi-level Benchmark for Agricultural Understanding and Reasoning ACL 2025