← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

How to Protect Yourself from 5G Radiation? Investigating LLM Responses to Implicit Misinformation EMNLP 2025
UNCLE: Benchmarking Uncertainty Expressions in Long-Form Generation EMNLP 2025
AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists EMNLP 2025
CausalVLBench: Benchmarking Visual Causal Reasoning in Large Vision-Language Models EMNLP 2025
Text2Vis: A Challenging and Diverse Benchmark for Generating Multimodal Visualizations from Text EMNLP 2025
Revealing and Mitigating the Challenge of Detecting Character Knowledge Errors in LLM Role-Playing EMNLP 2025
Benchmarking LLMs on Semantic Overlap Summarization EMNLP 2025
NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Calls EMNLP 2025
seqBench: A Tunable Benchmark to Quantify Sequential Reasoning Limits of LLMs EMNLP 2025
EquiBench: Benchmarking Large Language Models’ Reasoning about Program Semantics via Equivalence Checking EMNLP 2025
Reasoning Models Reason Well, Until They Don’t AACL 2025
DMT-RoleBench: A Dynamic Multi-Turn Dialogue Based Benchmark for Role-Playing Evaluation of Large Language Model and Agent AAAI 2025
Assessing the Creativity of LLMs in Proposing Novel Solutions to Mathematical Problems AAAI 2025
Evaluating Numeracy of Language Models as a Natural Language Inference Task NAACL 2025
TableBench: A Comprehensive and Complex Benchmark for Table Question Answering AAAI 2025
CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based Verification AAAI 2025
WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation NAACL 2025
VMLU Benchmarks: A comprehensive benchmark toolkit for Vietnamese LLMs ACL 2025
Reverse Question Answering: Can an LLM Write a Question so Hard (or Bad) that it Can’t Answer? NAACL 2025
How LLMs React to Industrial Spatio-Temporal Data? Assessing Hallucination with a Novel Traffic Incident Benchmark Dataset NAACL 2025
A Comprehensive Evaluation on Event Reasoning of Large Language Models AAAI 2025
Training on the Benchmark Is Not All You Need AAAI 2025
What can Large Language Models Capture about Code Functional Equivalence? NAACL 2025
ComprehendEdit: A Comprehensive Dataset and Evaluation Framework for Multimodal Knowledge Editing AAAI 2025
Expanding the WMT24++ Benchmark with Rumantsch Grischun, Sursilvan, Sutsilvan, Surmiran, Puter, and Vallader EMNLP 2025