Evaluation

Market-Bench: Benchmarking Large Language Models on Economic and Trade Competition ACL 2026 MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents ACL 2026 MASEval: Extending Multi-Agent Evaluation from Models to Systems ACL 2026 Masked by Consensus: Disentangling Privileged Knowledge in LLM Correctness ACL 2026 Mathematical Proof as a Litmus Test: Revealing Failure Modes of Advanced Large Reasoning Models ACL 2026 MathSight: A Benchmark Exploring Have Vision-Language Models Really Seen in University-Level Mathematical Reasoning? ACL 2026 Measuring and Mitigating Racial Bias in Embedding Models: A Comparative Study for Law Enforcement Retrieval ACL 2026 Measuring Distribution Shift in User Prompts and Its Effects on LLM Performance ACL 2026 Mediocrity is the key for LLM as a Judge Anchor Selection ACL 2026 MedMCP-Calc: Benchmarking LLMs for Realistic Medical Calculator Scenarios via MCP Integration ACL 2026 Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agents ACL 2026 MetaBench: A Multi-task Benchmark for Assessing LLMs in Metabolomics ACL 2026 METER: Evaluating Multi-Level Contextual Causal Reasoning in Large Language Models ACL 2026 Mind’s Eye: A Benchmark of Visual Abstraction, Transformation and Composition for Multimodal LLMs ACL 2026 Mind the (DH) Gap! A Contrast in Risky Choices Between Reasoning and Conversational LLMs ACL 2026 MirrorQA: Benchmarking Multimodal LLMs on Mirror-Orientation Reasoning ACL 2026 Mitigating Selection Bias in Large Language Models via Permutation-Aware GRPO ACL 2026 MMBench-GUI: A Unified Hierarchical Evaluation Framework for Multi-Platform GUI Agents CVPR 2026 MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Models ACL 2026 MM-JudgeBias: A Benchmark for Evaluating Compositional Biases in MLLM-as-a-Judge ACL 2026 MMSciCode: Real-world Evaluation of Multilingual Multi-Discipline Scientific Research Coding ACL 2026 MMTutorBench: The First Multimodal Benchmark for AI Math Tutoring ACL 2026 MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments ACL 2026 Monotonic Scaffolding as a Diagnostic Lens for Legal Reasoning in LLMs ACL 2026 More Than Meets the Eye: Measuring the Semiotic Gap in Vision-Language Models via Semantic Anchorage ACL 2026