Evaluation

GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI Tasks CVPR 2026 GUIDE: Towards Scalable Advising for Research Ideas ACL 2026 HalluAudio: A Comprehensive Benchmark for Hallucination Detection in Large Audio-Language Models ACL 2026 HalluCitation Matters: Revealing the Impact of Hallucinated References with 300 Hallucinated Papers in ACL Conferences ACL 2026 HalluGen: Synthesizing Realistic and Controllable Hallucinations for Evaluating Image Restoration CVPR 2026 Hard2Verify: A Step-Level Verification Benchmark for Open-Ended Frontier Math ACL 2026 HarDBench: A Benchmark for Draft-Based Co-Authoring Jailbreak Attacks for Safe Human–LLM Collaborative Writing ACL 2026 HAVE-Bench: Hierarchical Audio-Visual Evaluation from Perception to Interaction CVPR 2026 hermeneutichools at SemEval-2026 Task 4: Multiperspectivity as a Resource for Narrative Similarity Prediction SemEval 2026 How Hard is Math? Using Quantitative Metrics to Measure LLM Alignment to Human Intuitions of Difficulty ACL 2026 How Long Reasoning Chains Influence LLMs’ Judgment of Answer Factuality ACL 2026 HoWToBench: Holistic Evaluation for LLM’s Capability in Human-level Writing using Tree of Writing ACL 2026 HSCodeComp: A Realistic and Expert-level Agent Benchmark for Hierarchical Rule Application ACL 2026 HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns ACL 2026 HumanVBench: Probing Human-Centric Video Understanding in MLLMs with Automatically Synthesized Benchmarks CVPR 2026 HypoEval: Hypothesis-Guided Evaluation for Natural Language Generation ACL 2026 I2I-Bench: A Comprehensive Benchmark Suite for Image-to-Image Editing Models CVPR 2026 If an LLM Were a Character, Would It Know Its Own Story? Evaluating Lifelong Learning in LLMs ACL 2026 IF-Bench: Benchmarking and Enhancing MLLMs for Infrared Images with Generative Visual Prompting CVPR 2026 IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following Evaluation ACL 2026 IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation ACL 2026 IGenBench: Benchmarking the Reliability of Text-to-Infographic Generation ACL 2026 Illusions of Confidence? Diagnosing LLM Truthfulness via Neighborhood Consistency ACL 2026 Illusions of the Gold Standard: A Large-scale Analysis of Human Evaluation Protocols for Long-form Text Generation ACL 2026 Immediate Inference: The Missing Foundation in Large Language Model Logical Reasoning ACL 2026