Evaluation

Flattery in Motion: Benchmarking and Analyzing Sycophancy in Video-LLMs ACL 2026 FPS-Bench: A Benchmark for High Frame-Rate Video Understanding CVPR 2026 From Charts to Code: A Hierarchical Benchmark for Multimodal Models ACL 2026 From Indoor to Open World: Revealing the Spatial Reasoning Gap in MLLMs CVPR 2026 From Where Things Are to What They Are For: Benchmarking Spatial-Functional Intelligence in Multimodal LLMs CVPR 2026 Full-Duplex-Bench-v2: A Multi-Turn Evaluation Framework for Duplex Dialogue Systems with an Automated Examiner ACL 2026 FVBench: Benchmarking Deepfake Video Detection Capability of Large Multimodal Models CVPR 2026 GameplayQA: A Benchmarking Framework for Decision-Dense POV-Synced Multi-Video Understanding of 3D Virtual Agents ACL 2026 Gap-K%: Measuring Top-1 Prediction Gap for Detecting Pretraining Data ACL 2026 GenColorBench: A Color Evaluation Benchmark for Text-to-Image Generation CVPR 2026 Generalizable Video Quality Assessment via Weak-to-Strong Learning CVPR 2026 GenPT: Beyond Self-Report for Reliable LLM Psychometrics via Generative Projective Testing ACL 2026 GeoArena: Evaluating Open-World Geographic Reasoning in Large Vision-Language Models ACL 2026 GeoLaux: A Benchmark for Evaluating MLLMs’ Geometry Performance on Long-Step Problems Requiring Auxiliary Lines ACL 2026 GeoRC: A Benchmark for Geolocation Reasoning Chains ACL 2026 GGBench: A Geometric Generative Reasoning Benchmark for Unified Multimodal Models CVPR 2026 GitChameleon 2.0: Evaluating AI Code Generation Against Python Library Version Incompatibilities ACL 2026 Goldilocks Test Sets for Face Verification CVPR 2026 GQLBench: A Large-Scale Cross-Domain, Cross-Dialect Benchmark for NL2GQL ACL 2026 Graph2Eval: Automatic Multimodal Task Generation for Agents via Knowledge Graphs CVPR 2026 GroundingME: Exposing the Visual Grounding Gap in MLLMs through Multi-Dimensional Evaluation CVPR 2026 GroupToM-Bench: Benchmarking Group Theory of Mind and Nonlinear Social Emergence in MLLMs ACL 2026 GTA: Generating Long-horizon Tasks for Web Agents at Scale ACL 2026 GT-SVJ: Generative-Transformer-Based Self-Supervised Video Judge For Efficient Video Reward Modeling CVPR 2026 GUI-CEval: A Hierarchical and Comprehensive Chinese Benchmark for Mobile GUI Agents CVPR 2026