conftrace_

reasoning benchmark

44 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) reasoning evaluation (63) logical reasoning (310) multimodal reasoning (197) theory of mind (122) multimodal large language model (966) visual reasoning (493) language model evaluation (227) model evaluation (445)

Papers

Benchmarking Fine-Grained Error Detection in Multimodal Reasoning ACL 2026
Reasoning Gets Harder for LLMs Inside A Dialogue ACL 2026
RiddleBench: A New Generative Reasoning Benchmark for LLMs EACL 2026
OMIBench: Benchmarking Olympiad-Level Multi-Image Reasoning in Large Vision-Language Models ACL 2026
Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It EACL 2026
MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation ACL 2026
Temporal Sampling for Forgotten Reasoning in LLMs ACL 2026
LOFT: Scalable and More Realistic Long-Context Evaluation NAACL 2025
MMReason: An Open-Ended Multi-Modal Multi-Step Reasoning Benchmark for MLLMs Toward AGI ICCV 2025
Code Execution as Grounded Supervision for LLM Reasoning EMNLP 2025
ThinkSLM: Towards Reasoning in Small Language Models EMNLP 2025
BIG-Bench Extra Hard ACL 2025
Evaluating LLMs with Multiple Problems at once ACL 2025
RCScore: Quantifying Response Consistency in Large Language Models EMNLP 2025
Reasoning is All You Need for Video Generalization: A Counterfactual Benchmark with Sub-question Evaluation ACL 2025
MPBench: A Comprehensive Multimodal Reasoning Benchmark for Process Errors Identification ACL 2025
AnaToM: A Dataset Generation Framework for Evaluating Theory of Mind Reasoning Toward the Anatomy of Difficulty through Structurally Controlled Story Generation AACL 2025
Can Large Language Models Detect Errors in Long Chain-of-Thought Reasoning? ACL 2025
AutoMixer: Checkpoint Artifacts as Automatic Data Mixers ACL 2025
SCITAT: A Question Answering Benchmark for Scientific Tables and Text Covering Diverse Reasoning Types ACL 2025
Recitation over Reasoning: How Cutting-Edge Language Models Can Fail on Elementary School-Level Reasoning Problems? IJCNLP 2025
On Memorization of Large Language Models in Logical Reasoning IJCNLP 2025
Concise and Organized Perception Facilitates Reasoning in Large Language Models NAACL 2025
ThinkSwitcher: When to Think Hard, When to Think Fast EMNLP 2025
Analyzing Dialectical Biases in LLMs for Knowledge and Reasoning Benchmarks EMNLP 2025