Evaluation

RPC-Bench: A Fine-grained Benchmark for Research Paper Comprehension ACL 2026 RubricBench: Aligning Model-Generated Rubrics with Human Standards ACL 2026 RubricHub: A Comprehensive and Highly Discriminative Rubric Dataset via Automated Coarse-to-Fine Generation ACL 2026 S2S-Arena: Evaluating Paralinguistic Instruction Following in Speech-to-Speech Models ACL 2026 SAGE: A Search-AuGmented Evaluation of Large Language Models on Free-Form QA ACL 2026 SAHM: A Benchmark for Arabic Financial and Shari’ah-Compliant Reasoning ACL 2026 SAJA: A Simple Approach to Judge Alignment for LLM-as-a-Judge ACL 2026 Same Content, Different Answers: Cross-Modal Inconsistency in MLLMs CVPR 2026 SATQuest: A Verifier for Logical Reasoning Evaluation and Reinforcement Fine-Tuning of LLMs ACL 2026 ScaleBox: Enabling High-Fidelity and Scalable Code Verification for Large Language Models ACL 2026 Scaling Reasoning, Losing Control: Evaluating Instruction Following in Large Reasoning Models ACL 2026 Scaling Test-Time Robustness of Vision-Language Models via Self-Critical Inference Framework CVPR 2026 SCAN: Structured Capability Assessment and Navigation for LLMs ACL 2026 SciCoQA: Quality Assurance for Scientific Paper–Code Alignment ACL 2026 SciCustom: A Framework for Custom Evaluation of Scientific Capabilities in Large Language Models ACL 2026 SCIEval: Evaluating and Benchmarking the Faithfulness of Scientific Image Generation and Interpretation with Large Multimodal Models CVPR 2026 SciFlow-Bench: Evaluating Structure-Aware Scientific Diagram Generation via Inverse Parsing ACL 2026 SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios ACL 2026 Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems ACL 2026 SemEval-2026 Task 7: Everyday Knowledge Across Diverse Languages and Cultures SemEval 2026 ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services ACL 2026 SGVEF-LOOP: Coverage-Guided Progressive Topological Exploration and Fact-Grounded Metamorphic Evaluation for MCP Agents ACL 2026 SILO-BENCH: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systems ACL 2026 Simple Agents, Biased Judges: Efficient Multi-Party Dialogue Generation & The Evaluation Gap ACL 2026 SkMTEB: Slovak Massive Text Embedding Benchmark and Model Adaptation ACL 2026