Skip to content
conftrace_

reasoning evaluation

65 papers

Papers

Cards Against Contamination: TCG-Bench for Difficulty-Scalable Multilingual LLM Reasoning EACL 2026 Evaluation of Deontic Conditional Reasoning in Large Language Models: The Case of Wason’s Selection Task EACL 2026 J4R: Learning to Judge with Equivalent Initial State Group Relative Policy Optimization ACL 2026 JudgeBoard: Benchmarking and Enhancing Small Language Models for Reasoning Evaluation AAAI 2026 Measuring the Unmeasurable: Unveiling Latent Cognitive Capabilities of LLM AAAI 2026 TRACE: A Framework for Analyzing and Enhancing Stepwise Reasoning in Vision-Language Models EACL 2026 AraEval: An Arabic Multi-Task Evaluation Suite for Large Language Models EMNLP 2025 ARC ‘Challenge’ Is Not That Challenging ACL 2025 BIG-Bench Extra Hard ACL 2025 Cascaded Information Disclosure for Generalized Evaluation of Problem Solving Capabilities IJCNLP 2025 Conceptual Diagnostics for Knowledge Graphs and Large Language Models ACL 2025 Don’t Take the Premise for Granted: Evaluating the Premise Critique Ability of Large Language Models EMNLP 2025 Enhancing Graph Of Thought: Enhancing Prompts with LLM Rationales and Dynamic Temperature Control ICLR 2025 Evaluating Mathematical Reasoning Beyond Accuracy AAAI 2025 Evaluating Step-by-step Reasoning Traces: A Survey EMNLP 2025 Exposing the Achilles’ Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning ACL 2025 Findings of the WMT25 Multilingual Instruction Shared Task: Persistent Hurdles in Reasoning, Generation, and Evaluation EMNLP 2025 GameArena: Evaluating LLM Reasoning through Live Computer Games ICLR 2025 GAMEBoT: Transparent Assessment of LLM Reasoning in Games ACL 2025 HATS : Hindi Analogy Test Set for Evaluating Reasoning in Large Language Models ACL 2025 Idola Tribus of AI: Large Language Models tend to perceive order where none exists EMNLP 2025 InMind: Evaluating LLMs in Capturing and Applying Individual Human Reasoning Styles EMNLP 2025 Large Language Models Have Intrinsic Meta-Cognition, but Need a Good Lens EMNLP 2025 MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation NAACL 2025 Not quite Sherlock Holmes: Language model predictions do not reliably differentiate impossible from improbable events ACL 2025