reasoning benchmark

Benchmarking Fine-Grained Error Detection in Multimodal Reasoning ACL 2026 Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It EACL 2026 MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation ACL 2026 OMIBench: Benchmarking Olympiad-Level Multi-Image Reasoning in Large Vision-Language Models ACL 2026 Reasoning Gets Harder for LLMs Inside A Dialogue ACL 2026 RiddleBench: A New Generative Reasoning Benchmark for LLMs EACL 2026 Temporal Sampling for Forgotten Reasoning in LLMs ACL 2026 TiViBench: Benchmarking Think-in-Video Reasoning for Video Generation CVPR 2026 When Visualizing is the First Step to Reasoning: MIRA, a Benchmark for Visual Chain-of-Thought CVPR 2026 Analyzing Dialectical Biases in LLMs for Knowledge and Reasoning Benchmarks EMNLP 2025 AutoMixer: Checkpoint Artifacts as Automatic Data Mixers ACL 2025 BIG-Bench Extra Hard ACL 2025 Can Large Language Models Detect Errors in Long Chain-of-Thought Reasoning? ACL 2025 CipherBank: Exploring the Boundary of LLM Reasoning Capabilities through Cryptography Challenge ACL 2025 Code Execution as Grounded Supervision for LLM Reasoning EMNLP 2025 Concise and Organized Perception Facilitates Reasoning in Large Language Models NAACL 2025 Demystifying Multilingual Reasoning in Process Reward Modeling EMNLP 2025 Evaluating LLMs with Multiple Problems at once ACL 2025 KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Tasks ICLR 2025 LOFT: Scalable and More Realistic Long-Context Evaluation NAACL 2025 MARS: Benchmarking the Metaphysical Reasoning Abilities of Language Models with a Multi-task Evaluation Dataset ACL 2025 Mind Your Theory: Theory of Mind Goes Deeper Than Reasoning ACL 2025 MMReason: An Open-Ended Multi-Modal Multi-Step Reasoning Benchmark for MLLMs Toward AGI ICCV 2025 MPBench: A Comprehensive Multimodal Reasoning Benchmark for Process Errors Identification ACL 2025 On Memorization of Large Language Models in Logical Reasoning IJCNLP 2025