benchmark evaluation

GRI-QA: a Comprehensive Benchmark for Table Question Answering over Environmental Data ACL 2025 GroundCocoa: A Benchmark for Evaluating Compositional & Conditional Reasoning in Language Models NAACL 2025 GroUSE: A Benchmark to Evaluate Evaluators in Grounded Question Answering COLING 2025 GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models ICLR 2025 GuessArena: Guess Who I Am? A Self-Adaptive Framework for Evaluating LLMs in Domain-Specific Knowledge and Reasoning ACL 2025 Guess What I am Thinking: A Benchmark for Inner Thought Reasoning of Role-Playing Language Agents EMNLP 2025 HALLUCINOGEN: Benchmarking Hallucination in Implicit Reasoning within Large Vision Language Models EMNLP 2025 HALoGEN: Fantastic LLM Hallucinations and Where to Find Them ACL 2025 Hanfu-Bench: A Multimodal Benchmark on Cross-Temporal Cultural Understanding and Transcreation EMNLP 2025 Hatevolution: What Static Benchmarks Don’t Tell Us ACL 2025 HATS : Hindi Analogy Test Set for Evaluating Reasoning in Large Language Models ACL 2025 Have We Designed Generalizable Structural Knowledge Promptings? Systematic Evaluation and Rethinking ACL 2025 HELMET: How to Evaluate Long-context Models Effectively and Thoroughly ICLR 2025 HighMATH: Evaluating Math Reasoning of Large Language Models in Breadth and Depth EMNLP 2025 How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts? EMNLP 2025 How does Misinformation Affect Large Language Model Behaviors and Preferences? ACL 2025 How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehension ICLR 2025 How Do Multimodal Large Language Models Handle Complex Multimodal Reasoning? Placing Them in An Extensible Escape Game ICCV 2025 How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulation ACL 2025 How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmark EMNLP 2025 How LLMs React to Industrial Spatio-Temporal Data? Assessing Hallucination with a Novel Traffic Incident Benchmark Dataset NAACL 2025 How to Evaluate Reward Models for RLHF ICLR 2025 How to Protect Yourself from 5G Radiation? Investigating LLM Responses to Implicit Misinformation EMNLP 2025 HRScene: How Far Are VLMs from Effective High-Resolution Image Understanding? ICCV 2025 HuGME: A benchmark system for evaluating Hungarian generative LLMs ACL 2025