Ashish Sabharwal

Answer, Assemble, Ace: Understanding How LMs Answer Multiple Choice Questions ICLR 2025 ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoning ICML 2025 Understanding the Logic of Direct Preference Alignment through Logic ICML 2025 DiscoveryBench: Towards Data-Driven Discovery with Large Language Models ICLR 2025 The Expressive Power of Transformers with Chain of Thought ICLR 2024 Position: Data-driven Discovery with Large Generative Models ICML 2024 Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs ICLR 2024 Closing the Curious Case of Neural Text Degeneration ICLR 2024 Leveraging Code to Improve In-Context Learning for Semantic Parsing NAACL 2024 QualEval: Qualitative Evaluation for Model Improvement NAACL 2024 SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories EMNLP 2024 The Illusion of State in State-Space Models ICML 2024 AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents ACL 2024 ADaPT: As-Needed Decomposition and Planning with Language Models NAACL 2024 DISCO: Distilling Counterfactuals with Large Language Models ACL 2023 Specializing Smaller Language Models towards Multi-Step Reasoning ICML 2023 Decomposed Prompting: A Modular Approach for Solving Complex Tasks ICLR 2023 Complexity-Based Prompting for Multi-step Reasoning ICLR 2023 A Logic for Expressing Log-Precision Transformers NIPS 2023 IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositions EMNLP 2023 Increasing Probability Mass on Answer Choices Does Not Always Improve Accuracy EMNLP 2023 Language Models with Rationality EMNLP 2023 Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions ACL 2023 Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts EMNLP 2022 Breakpoint Transformers for Modeling and Tracking Intermediate Beliefs EMNLP 2022 Multi-Modal Answer Validation for Knowledge-Based VQA AAAI 2022 Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability AAAI 2022 Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts NAACL 2022 Hey AI, Can You Solve Complex Tasks by Talking to Agents? ACL 2022 What Makes Instruction Learning Hard? An Investigation and a New Challenge in a Synthetic Environment EMNLP 2022 LILA: A Unified Benchmark for Mathematical Reasoning EMNLP 2022 Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Models NAACL 2021 Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions? IJCNLP 2021 ReadOnce Transformers: Reusable Representations of Text for Transformers ACL 2021 ReadOnce Transformers: Reusable Representations of Text for Transformers IJCNLP 2021 How much coffee was consumed during EMNLP 2019? Fermi Problems: A New Reasoning Challenge for AI EMNLP 2021 GooAQ: Open Question Answering with Diverse Answer Types EMNLP 2021 Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions? ACL 2021 Temporal Reasoning on Implicit Events from Distant Supervision NAACL 2021 Adversarial Filters of Dataset Biases ICML 2020 Belief Propagation Neural Networks NIPS 2020 QASC: A Dataset for Question Answering via Sentence Composition AAAI 2020 Probing Natural Language Inference Models through Semantic Fragments AAAI 2020 Not All Claims are Created Equal: Choosing the Right Statistical Approach to Assess Hypotheses ACL 2020 More Bang for Your Buck: Natural Perturbation for Robust Question Answering EMNLP 2020 A Simple Yet Strong Pipeline for HotpotQA EMNLP 2020 Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected Reasoning EMNLP 2020 UNIFIEDQA: Crossing Format Boundaries with a Single QA System EMNLP 2020 UNQOVERing Stereotyping Biases via Underspecified Questions EMNLP 2020 What’s Missing: A Knowledge Gap Guided Approach for Multi-hop Question Answering EMNLP 2019 Exploiting Explicit Paths for Multi-hop Reading Comprehension ACL 2019 What’s Missing: A Knowledge Gap Guided Approach for Multi-hop Question Answering IJCNLP 2019 QUAREL: A Dataset and Models for Answering Questions about Qualitative Relationships AAAI 2019 Approximating the Permanent by Sampling from Adaptive Partitions NIPS 2019 Repurposing Entailment for Multi-Hop Question Answering Tasks NAACL 2019 Adaptive Hashing for Model Counting UAI 2019 Bridging Knowledge Gaps in Neural Entailment via Symbolic Models EMNLP 2018 Expanding Holographic Embeddings for Knowledge Completion NIPS 2018 Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering EMNLP 2018 AdvEntuRe: Adversarial Training for Textual Entailment with Knowledge-Guided Examples ACL 2018 Learning What is Essential in Questions CONLL 2017 Answering Complex Questions Using Open Information Extraction ACL 2017 Question Answering via Integer Programming over Semi-Structured Knowledge IJCAI 2016 Adaptive Concentration Inequalities for Sequential Decision Problems NIPS 2016 Beyond Parity Constraints: Fourier Analysis of Hash Functions for Inference ICML 2016 Exploring Markov Logic Networks for Question Answering EMNLP 2015 Low-density Parity Constraints for Hashing-Based Discrete Integration ICML 2014 Taming the Curse of Dimensionality: Discrete Integration by Hashing and Optimization ICML 2013 Algorithm Portfolios Based on Cost-Sensitive Hierarchical Clustering IJCAI 2013 Embed and Project: Discrete Sampling with Universal Hashing NIPS 2013 Density Propagation and Improved Bounds on the Partition Function NIPS 2012 Accelerated Adaptive Markov Chain for Partition Function Computation NIPS 2011 Counting Solution Clusters in Graph Coloring Problems Using Belief Propagation NIPS 2008 Near-Uniform Sampling of Combinatorial Spaces Using XOR Constraints NIPS 2006