reasoning evaluation

On LLM-Based Scientific Inductive Reasoning Beyond Equations EMNLP 2025 OpenHuEval: Evaluating Large Language Model on Hungarian Specifics ACL 2025 PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning ACL 2025 ProJudge: A Multi-Modal Multi-Discipline Benchmark and Instruction-Tuning Dataset for MLLM-based Process Judges ICCV 2025 Recitation over Reasoning: How Cutting-Edge Language Models Can Fail on Elementary School-Level Reasoning Problems? IJCNLP 2025 Revitalizing Saturated Benchmarks: A Weighted Metric Approach for Differentiating Large Language Model Performance NAACL 2025 Temporalizing Confidence: Evaluation of Chain-of-Thought Reasoning with Signal Temporal Logic ACL 2025 A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners EMNLP 2024 Are Machines Better at Complex Reasoning? Unveiling Human-Machine Inference Gaps in Entailment Verification ACL 2024 Belief Revision: The Adaptability of Large Language Models Reasoning EMNLP 2024 Competition-Level Problems are Effective LLM Evaluators ACL 2024 CriticBench: Benchmarking LLMs for Critique-Correct Reasoning ACL 2024 Discursive Socratic Questioning: Evaluating the Faithfulness of Language Models’ Understanding of Discourse Relations ACL 2024 Do great minds think alike? Investigating Human-AI Complementarity in Question Answering with CAIMIRA EMNLP 2024 From Generation to Selection: Findings of Converting Analogical Problem-Solving into Multiple-Choice Questions EMNLP 2024 GeminiPro at SemEval-2024 Task 9: BrainTeaser on Gemini SemEval 2024 Liar, Liar, Logical Mire: A Benchmark for Suppositional Reasoning in Large Language Models EMNLP 2024 LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models EMNLP 2024 MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning ICLR 2024 Propagation and Pitfalls: Reasoning-based Assessment of Knowledge Editing through Counterfactual Tasks ACL 2024 Rationales for Answers to Simple Math Word Problems Confuse Large Language Models ACL 2024 Reasoning or a Semblance of it? A Diagnostic Study of Transitive Reasoning in LLMs EMNLP 2024 ReMI: A Dataset for Reasoning with Multiple Images NeurIPS 2024 S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Model NAACL 2024 Self-contradictory reasoning evaluation and detection EMNLP 2024