reasoning evaluation

SemEval-2024 Task 9: BRAINTEASER: A Novel Task Defying Common Sense SemEval 2024 SocREval: Large Language Models with the Socratic Method for Reference-free Reasoning Evaluation NAACL 2024 TuringQ: Benchmarking AI Comprehension in Theory of Computation EMNLP 2024 Understanding Faithfulness and Reasoning of Large Language Models on Plain Biomedical Summaries EMNLP 2024 Weak-eval-Strong: Evaluating and Eliciting Lateral Thinking of LLMs with Situation Puzzles NeurIPS 2024 When Reasoning Meets Information Aggregation: A Case Study with Sports Narratives EMNLP 2024 A Benchmark for Reasoning with Spatial Prepositions EMNLP 2023 Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate EMNLP 2023 Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them ACL 2023 LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models NeurIPS 2023 PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change NeurIPS 2023 ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning ICLR 2023 Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding EMNLP 2021 R4C: A Benchmark for Evaluating RC Systems to Get the Right Answer for the Right Reason ACL 2020 Collecting Diverse Natural Language Inference Problems for Sentence Representation Evaluation EMNLP 2018