conftrace_

reasoning evaluation

63 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) question answering (2963) reasoning benchmark (44) evaluation benchmark (257) logical reasoning (310) chain-of-thought prompting (313) chain-of-thought reasoning (551) multilingual nlp (1426) lateral thinking (35)

Papers

Evaluation of Deontic Conditional Reasoning in Large Language Models: The Case of Wason’s Selection Task EACL 2026
Cards Against Contamination: TCG-Bench for Difficulty-Scalable Multilingual LLM Reasoning EACL 2026
JudgeBoard: Benchmarking and Enhancing Small Language Models for Reasoning Evaluation AAAI 2026
TRACE: A Framework for Analyzing and Enhancing Stepwise Reasoning in Vision-Language Models EACL 2026
Measuring the Unmeasurable: Unveiling Latent Cognitive Capabilities of LLM AAAI 2026
J4R: Learning to Judge with Equivalent Initial State Group Relative Policy Optimization ACL 2026
Findings of the WMT25 Multilingual Instruction Shared Task: Persistent Hurdles in Reasoning, Generation, and Evaluation EMNLP 2025
On LLM-Based Scientific Inductive Reasoning Beyond Equations EMNLP 2025
OpenHuEval: Evaluating Large Language Model on Hungarian Specifics ACL 2025
Temporalizing Confidence: Evaluation of Chain-of-Thought Reasoning with Signal Temporal Logic ACL 2025
Evaluating Step-by-step Reasoning Traces: A Survey EMNLP 2025
PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning ACL 2025
Idola Tribus of AI: Large Language Models tend to perceive order where none exists EMNLP 2025
Evaluating Mathematical Reasoning Beyond Accuracy AAAI 2025
GAMEBoT: Transparent Assessment of LLM Reasoning in Games ACL 2025
Large Language Models Have Intrinsic Meta-Cognition, but Need a Good Lens EMNLP 2025
Cascaded Information Disclosure for Generalized Evaluation of Problem Solving Capabilities IJCNLP 2025
InMind: Evaluating LLMs in Capturing and Applying Individual Human Reasoning Styles EMNLP 2025
Conceptual Diagnostics for Knowledge Graphs and Large Language Models ACL 2025
Revitalizing Saturated Benchmarks: A Weighted Metric Approach for Differentiating Large Language Model Performance NAACL 2025
BIG-Bench Extra Hard ACL 2025
Not quite Sherlock Holmes: Language model predictions do not reliably differentiate impossible from improbable events ACL 2025
HATS : Hindi Analogy Test Set for Evaluating Reasoning in Large Language Models ACL 2025
Cascaded Information Disclosure for Generalized Evaluation of Problem Solving Capabilities AACL 2025
MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation NAACL 2025