benchmark evaluation

MAPS: A Multilingual Benchmark for Agent Performance and Security EACL 2026 MarineEval: Assessing the Marine Intelligence of Vision-Language Models WACV 2026 MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents ACL 2026 MAVERIX: Multimodal Audio-Visual Evaluation and Recognition IndeX AAAI 2026 MCP-AgentBench: Evaluating Real-World Language Agent Performance with MCP-Mediated Tools AAAI 2026 MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models AAAI 2026 MetaEval: Measuring the Discrimination of Benchmarks for Efficient LLM Evaluation AAAI 2026 MicroEvoEval: A Systematic Evaluation Framework for Image-Based Microstructure Evolution Prediction AAAI 2026 Mind the Third Eye! Benchmarking Privacy Awareness in MLLM-powered Smartphone Agents AAAI 2026 MirrorCAPTCHA: Wild CAPTCHA, Wild Distribution, Wild Web-based Platform Meet Multimodal LLM Agents ACL 2026 MirrorQA: Benchmarking Multimodal LLMs on Mirror-Orientation Reasoning ACL 2026 MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligence AAAI 2026 MMBench-GUI: A Unified Hierarchical Evaluation Framework for Multi-Platform GUI Agents CVPR 2026 MovieGraph-ToM: Evaluating Long-Range Theory of Mind in Large Language Models via Implicit Social-Causal Graphs AAAI 2026 MTR-Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval Benchmarks ACL 2026 MULTIBENCH++: A Unified and Comprehensive Multimodal Fusion Benchmarking Across Specialized Domains AAAI 2026 Multimodal Evaluation of Russian-language Architectures EACL 2026 Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Image CVPR 2026 Nahw: A Comprehensive Benchmark of Arabic Grammar Understanding, Error Detection, Correction, and Explanation EACL 2026 NoReGeo: Non-Reasoning Geometry Benchmark AAAI 2026 OCRTurk: A Comprehensive OCR Benchmark for Turkish EACL 2026 OmniBench: A Comprehensive Benchmark Integrating Real-World, Time-sensitive, and Multi-Hop Questions with a Multi-Dimensional Hybrid Evaluation Framework AAAI 2026 OmniGround: A Comprehensive Spatio-Temporal Grounding Benchmark for Real-World Complex Scenarios CVPR 2026 One Battle After Another: Probing LLMs’ Limits on Multi-Turn Instruction Following with a Benchmark Evolving Framework ACL 2026 OpenLVLM-MIA: A Controlled Benchmark Revealing the Limits of Membership Inference Attacks on Large Vision-Language Models WACV 2026