benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

Zero-Shot Multi-Label Classification of Bangla Documents: Large Decoders Vs. Classic Encoders IJCNLP 2025

BHRAM-IL: A Benchmark for Hallucination Recognition and Assessment in Multiple Indian Languages IJCNLP 2025

Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM Evaluation IJCNLP 2025

Beyond the Rubric: Cultural Misalignment in LLM Benchmarks for Sexual and Reproductive Health IJCNLP 2025

A Comprehensive Evaluation on Event Reasoning of Large Language Models AAAI 2025

What can Large Language Models Capture about Code Functional Equivalence? NAACL 2025

CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based Verification AAAI 2025

WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation NAACL 2025

TeluguST-46: A Benchmark Corpus and Comprehensive Evaluation for Telugu-English Speech Translation IJCNLP 2025

TableBench: A Comprehensive and Complex Benchmark for Table Question Answering AAAI 2025

Assessing the Creativity of LLMs in Proposing Novel Solutions to Mathematical Problems AAAI 2025

Evaluating Numeracy of Language Models as a Natural Language Inference Task NAACL 2025

DMT-RoleBench: A Dynamic Multi-Turn Dialogue Based Benchmark for Role-Playing Evaluation of Large Language Model and Agent AAAI 2025

MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems NAACL 2025

DI-BENCH: Benchmarking Large Language Models on Dependency Inference with Testable Repositories at Scale ACL 2025

CharacterBench: Benchmarking Character Customization of Large Language Models AAAI 2025

Automated Evaluation of Large Vision-Language Models on Self-Driving Corner Cases WACV 2025

Visual Robustness Benchmark for Visual Question Answering (VQA) WACV 2025

RCI: A Score for Evaluating Global and Local Reasoning in Multimodal Benchmarks EMNLP 2025

MultiHoax: A Dataset of Multi-hop False-premise questions ACL 2025

WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code ACL 2025

Truth Behind the Scene: Designing Evaluations Benchmarks to Assess LLMs’ Task-Specific Understanding over Test-Taking Strategies AAAI 2025

Cherry-Picking in Time Series Forecasting: How to Select Datasets to Make Your Model Shine AAAI 2025

Assessing Visually-Continuous Corruption Robustness of Neural Networks Relative to Human Performance WACV 2025

LIME: Less Is More for MLLM Evaluation ACL 2025