benchmark evaluation

WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code ACL 2025 We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning? ACL 2025 WeQA: A Benchmark for Retrieval Augmented Generation in Wind Energy Domain ACL 2025 What are Foundation Models Cooking in the Post-Soviet World? EMNLP 2025 What can Large Language Models Capture about Code Functional Equivalence? NAACL 2025 “What do you call a dog that is incontrovertibly true? Dogma”: Testing LLM Generalization through Humor ACL 2025 What Makes Cryptic Crosswords Challenging for LLMs? COLING 2025 What’s Not Said Still Hurts: A Description-Based Evaluation Framework for Measuring Social Bias in LLMs EMNLP 2025 What Would You Ask When You First Saw a2+b2=c2? Evaluating LLM on Curiosity-Driven Question Generation IJCNLP 2025 When2Call: When (not) to Call Tools NAACL 2025 When Instructions Multiply: Measuring and Estimating LLM Capabilities of Multiple Instructions Following EMNLP 2025 Where Are We? Evaluating LLM Performance on African Languages ACL 2025 Why Stop at One Error? Benchmarking LLMs as Data Science Code Debuggers for Multi-Hop and Multi-Bug Errors EMNLP 2025 WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging ACL 2025 WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild ICLR 2025 WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild? EMNLP 2025 WildScore: Benchmarking MLLMs in-the-Wild Symbolic Music Reasoning EMNLP 2025 WinoWhat: A Parallel Corpus of Paraphrased WinoGrande Sentences with Common Sense Categorization CoNLL 2025 WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation NAACL 2025 WXImpactBench: A Disruptive Weather Impact Understanding Benchmark for Evaluating Large Language Models ACL 2025 XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoning ACL 2025 X-LeBench: A Benchmark for Extremely Long Egocentric Video Understanding EMNLP 2025 XLQA: A Benchmark for Locale-Aware Multilingual Open-Domain Question Answering EMNLP 2025 XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery? CVPR 2025 causalAssembly: Generating Realistic Production Data for Benchmarking Causal Discovery CLeaR 2024