conftrace_

reasoning evaluation

63 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) question answering (2963) reasoning benchmark (44) evaluation benchmark (257) logical reasoning (310) chain-of-thought prompting (313) chain-of-thought reasoning (551) multilingual nlp (1426) lateral thinking (35)

Papers

CriticBench: Benchmarking LLMs for Critique-Correct Reasoning ACL 2024
Are Machines Better at Complex Reasoning? Unveiling Human-Machine Inference Gaps in Entailment Verification ACL 2024
Self-contradictory reasoning evaluation and detection EMNLP 2024
Reasoning or a Semblance of it? A Diagnostic Study of Transitive Reasoning in LLMs EMNLP 2024
Do great minds think alike? Investigating Human-AI Complementarity in Question Answering with CAIMIRA EMNLP 2024
Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate EMNLP 2023
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them ACL 2023
LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models NIPS 2023
A Benchmark for Reasoning with Spatial Prepositions EMNLP 2023
PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change NIPS 2023
Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding EMNLP 2021
R4C: A Benchmark for Evaluating RC Systems to Get the Right Answer for the Right Reason ACL 2020
Collecting Diverse Natural Language Inference Problems for Sentence Representation Evaluation EMNLP 2018