Skip to content
conftrace_

benchmark evaluation

1,616 papers

Papers

FormGym: Doing Paperwork with Agents EACL 2026 FPS-Bench: A Benchmark for High Frame-Rate Video Understanding CVPR 2026 From Benchmarks to Business Impact: Deploying IBM Generalist Agent in Enterprise Production AAAI 2026 Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It EACL 2026 Geometrically-Constrained Agent for Spatial Reasoning CVPR 2026 GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensing CVPR 2026 GGBench: A Geometric Generative Reasoning Benchmark for Unified Multimodal Models CVPR 2026 GitTaskBench: A Benchmark for Code Agents Solving Real-World Tasks Through Code Repository Leveraging AAAI 2026 GraphVLM: Benchmarking Vision Language Models for Multimodal Graph Learning CVPR 2026 GUI-CEval: A Hierarchical and Comprehensive Chinese Benchmark for Mobile GUI Agents CVPR 2026 HAVE-Bench: Hierarchical Audio-Visual Evaluation from Perception to Interaction CVPR 2026 Hire Your Anthropologist! Rethinking Culture Benchmarks Through an Anthropological Lens EACL 2026 How Much Do Large Language Model Cheat on Evaluation? Benchmarking Overestimation Under the One-Time-Pad-Based Framework AAAI 2026 How Robust Are Router-LLMs? Analysis of the Fragility of LLM Routing Capabilities EACL 2026 HPSU: A Benchmark for Human-Level Perception in Real-World Spoken Speech Understanding AAAI 2026 HumanBench: Two Heads, No Legs, But Mostly Human, the State of Generative Capabilities in T2I Models WACV 2026 JanusMM: A Benchmark for Self-Deprecation Understanding in Real-World Multimodal Conversations ACL 2026 KazakhOCR: A Synthetic Benchmark for Evaluating Multimodal Models in Low-Resource Kazakh Script OCR EACL 2026 KGHaluBench: A Knowledge Graph-Based Hallucination Benchmark for Evaluating the Breadth and Depth of LLM Knowledge EACL 2026 Large Language Models Struggle with Unreasonability in Math Problems AAAI 2026 LLMTM: Benchmarking and Optimizing LLMs for Temporal Motif Analysis in Dynamic Graphs AAAI 2026 LocalBench: Benchmarking LLMs on County-Level Local Knowledge and Reasoning AAAI 2026 Long-form RewardBench: Evaluating Reward Models for Long-form Generation AAAI 2026 Lost in Benchmarks? Rethinking Large Language Model Benchmarking with Item Response Theory AAAI 2026 M4U: Evaluating Multilingual Understanding and Reasoning for Large Multimodal Models WACV 2026