Ashish Sabharwal

Answer, Assemble, Ace: Understanding How LMs Answer Multiple Choice Questions ICLR 2025 DiscoveryBench: Towards Data-Driven Discovery with Large Language Models ICLR 2025 Understanding the Logic of Direct Preference Alignment through Logic ICML 2025 ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoning ICML 2025 ADaPT: As-Needed Decomposition and Planning with Language Models NAACL 2024 AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents ACL 2024 Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs ICLR 2024 Closing the Curious Case of Neural Text Degeneration ICLR 2024 Leveraging Code to Improve In-Context Learning for Semantic Parsing NAACL 2024 Position: Data-driven Discovery with Large Generative Models ICML 2024 QualEval: Qualitative Evaluation for Model Improvement NAACL 2024 SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories EMNLP 2024 The Expressive Power of Transformers with Chain of Thought ICLR 2024 The Illusion of State in State-Space Models ICML 2024 A Logic for Expressing Log-Precision Transformers NeurIPS 2023 Complexity-Based Prompting for Multi-step Reasoning ICLR 2023 Decomposed Prompting: A Modular Approach for Solving Complex Tasks ICLR 2023 DISCO: Distilling Counterfactuals with Large Language Models ACL 2023 IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositions EMNLP 2023 Increasing Probability Mass on Answer Choices Does Not Always Improve Accuracy EMNLP 2023 Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions ACL 2023 Language Models with Rationality EMNLP 2023 Specializing Smaller Language Models towards Multi-Step Reasoning ICML 2023 Breakpoint Transformers for Modeling and Tracking Intermediate Beliefs EMNLP 2022 Hey AI, Can You Solve Complex Tasks by Talking to Agents? ACL 2022 LILA: A Unified Benchmark for Mathematical Reasoning EMNLP 2022 Multi-Modal Answer Validation for Knowledge-Based VQA AAAI 2022 Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts NAACL 2022 Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability AAAI 2022 Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts EMNLP 2022 What Makes Instruction Learning Hard? An Investigation and a New Challenge in a Synthetic Environment EMNLP 2022 Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions? ACL 2021 GooAQ: Open Question Answering with Diverse Answer Types EMNLP 2021 How much coffee was consumed during EMNLP 2019? Fermi Problems: A New Reasoning Challenge for AI EMNLP 2021 ReadOnce Transformers: Reusable Representations of Text for Transformers ACL 2021 Temporal Reasoning on Implicit Events from Distant Supervision NAACL 2021 Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Models NAACL 2021 Adversarial Filters of Dataset Biases ICML 2020 A Simple Yet Strong Pipeline for HotpotQA EMNLP 2020 Belief Propagation Neural Networks NeurIPS 2020 Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected Reasoning EMNLP 2020 More Bang for Your Buck: Natural Perturbation for Robust Question Answering EMNLP 2020 Not All Claims are Created Equal: Choosing the Right Statistical Approach to Assess Hypotheses ACL 2020 Probing Natural Language Inference Models through Semantic Fragments AAAI 2020 QASC: A Dataset for Question Answering via Sentence Composition AAAI 2020 UNIFIEDQA: Crossing Format Boundaries with a Single QA System EMNLP 2020 UNQOVERing Stereotyping Biases via Underspecified Questions EMNLP 2020 Adaptive Hashing for Model Counting UAI 2019 Approximating the Permanent by Sampling from Adaptive Partitions NeurIPS 2019 Exploiting Explicit Paths for Multi-hop Reading Comprehension ACL 2019 QUAREL: A Dataset and Models for Answering Questions about Qualitative Relationships AAAI 2019 Repurposing Entailment for Multi-Hop Question Answering Tasks NAACL 2019 What’s Missing: A Knowledge Gap Guided Approach for Multi-hop Question Answering EMNLP 2019 AdvEntuRe: Adversarial Training for Textual Entailment with Knowledge-Guided Examples ACL 2018 Bridging Knowledge Gaps in Neural Entailment via Symbolic Models EMNLP 2018 Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering EMNLP 2018 Expanding Holographic Embeddings for Knowledge Completion NeurIPS 2018 Answering Complex Questions Using Open Information Extraction ACL 2017 Learning What is Essential in Questions CoNLL 2017 Adaptive Concentration Inequalities for Sequential Decision Problems NeurIPS 2016 Beyond Parity Constraints: Fourier Analysis of Hash Functions for Inference ICML 2016 Question Answering via Integer Programming over Semi-Structured Knowledge IJCAI 2016 Exploring Markov Logic Networks for Question Answering EMNLP 2015 Low-density Parity Constraints for Hashing-Based Discrete Integration ICML 2014 Algorithm Portfolios Based on Cost-Sensitive Hierarchical Clustering IJCAI 2013 Embed and Project: Discrete Sampling with Universal Hashing NeurIPS 2013 Taming the Curse of Dimensionality: Discrete Integration by Hashing and Optimization ICML 2013 Density Propagation and Improved Bounds on the Partition Function NeurIPS 2012 Accelerated Adaptive Markov Chain for Partition Function Computation NeurIPS 2011 Counting Solution Clusters in Graph Coloring Problems Using Belief Propagation NeurIPS 2008 Near-Uniform Sampling of Combinatorial Spaces Using XOR Constraints NeurIPS 2006