Jonathan Berant

Comparing human and language models sentence processing difficulties on complex structures ACL 2026 InfAlign: Inference-aware language model alignment ICML 2025 Theoretical guarantees on the best-of-n alignment policy ICML 2025 In-Context Learning with Long-Context Models: An In-Depth Exploration NAACL 2025 Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors (Extended Abstract) IJCAI 2025 When the LM misunderstood the human chuckled: Analyzing garden path effects in humans and language models ACL 2025 Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoning ICLR 2025 Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors ICLR 2024 SEMQA: Semi-Extractive Multi-Source Question Answering NAACL 2024 Large Language Models for Psycholinguistic Plausibility Pretesting EACL 2024 Transforming and Combining Rewards for Aligning Large Language Models ICML 2024 Making Retrieval-Augmented Language Models Robust to Irrelevant Context ICLR 2024 AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks? EMNLP 2024 Analyzing Transformers in Embedding Space ACL 2023 Diverse Demonstrations Improve In-context Compositional Generalization ACL 2023 From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces NIPS 2023 QAMPARI: A Benchmark for Open-domain Questions with Many Answers EMNLP 2023 ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding EMNLP 2023 Answering Questions by Meta-Reasoning over Multiple Chains of Thought EMNLP 2023 Crawling The Internal Knowledge-Base of Language Models EACL 2023 What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary ACL 2023 Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments EMNLP 2022 Diagonal State Spaces are as Effective as Structured State Spaces NIPS 2022 Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills ACL 2022 Unobserved Local Structures Make Compositional Generalization Hard EMNLP 2022 SCROLLS: Standardized CompaRison Over Long Language Sequences EMNLP 2022 Inferring Implicit Relations in Complex Questions with Language Models EMNLP 2022 Learning To Retrieve Prompts for In-Context Learning NAACL 2022 Learning to Retrieve Passages without Supervision NAACL 2022 Weakly Supervised Text-to-SQL Parsing through Question Decomposition NAACL 2022 Few-Shot Question Answering by Pretraining Span Selection IJCNLP 2021 SmBoP: Semi-autoregressive Bottom-up Semantic Parsing IJCNLP 2021 Evaluating the Evaluation of Diversity in Natural Language Generation EACL 2021 BERTese: Learning to Speak to BERT EACL 2021 Span-based Semantic Parsing for Compositional Generalization ACL 2021 SmBoP: Semi-autoregressive Bottom-up Semantic Parsing ACL 2021 Achieving Model Robustness through Discrete Adversarial Training EMNLP 2021 Transformer Feed-Forward Layers Are Key-Value Memories EMNLP 2021 What’s in Your Head? Emergent Behaviour in Multi-Task Transformer Models EMNLP 2021 Value-aware Approximate Attention EMNLP 2021 COVR: A Test-Bed for Visually Grounded Compositional Generalization with Real Images EMNLP 2021 Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization EMNLP 2021 Memory-efficient Transformers via Top-k Attention EMNLP 2021 Few-Shot Question Answering by Pretraining Span Selection ACL 2021 SmBoP: Semi-autoregressive Bottom-up Semantic Parsing NAACL 2021 MultiModalQA: complex question answering over text, tables and images ICLR 2021 Span-based Semantic Parsing for Compositional Generalization IJCNLP 2021 A Simple and Effective Model for Answering Multi-span Questions EMNLP 2020 Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge NIPS 2020 Obtaining Faithful Interpretations from Compositional Neural Networks ACL 2020 Injecting Numerical Reasoning Skills into Language Models ACL 2020 Differentiable Scene Graphs WACV 2020 Evaluating Models’ Local Decision Boundaries via Contrast Sets EMNLP 2020 Improving Compositional Generalization in Semantic Parsing EMNLP 2020 On Making Reading Comprehension More Comprehensive EMNLP 2019 DiscoFuse: A Large-Scale Dataset for Discourse-Based Sentence Fusion NAACL 2019 Evaluating Text GANs as Language Models NAACL 2019 Value-based Search in Execution Space for Mapping Instructions to Programs NAACL 2019 White-to-Black: Efficient Distillation of Black-Box Adversarial Attacks NAACL 2019 Global Reasoning over Database Structures for Text-to-SQL Parsing IJCNLP 2019 On the Limits of Learning to Actively Learn Semantic Representations CONLL 2019 MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension ACL 2019 Neural network gradient-based learning of black-box function interfaces ICLR 2019 Representing Schema Structure with Graph Neural Networks for Text-to-SQL Parsing ACL 2019 Don’t paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsing IJCNLP 2019 CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge NAACL 2019 Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets EMNLP 2019 Global Reasoning over Database Structures for Text-to-SQL Parsing EMNLP 2019 Don’t paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsing EMNLP 2019 Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets IJCNLP 2019 Memory Augmented Policy Optimization for Program Synthesis and Semantic Parsing NIPS 2018 Contextualized Word Representations for Reading Comprehension NAACL 2018 Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction NIPS 2018 Proceedings of the Workshop on Machine Reading for Question Answering ACL 2018 Learning to Search in Long Documents Using Document Structure COLING 2018 Weakly Supervised Semantic Parsing with Abstract Examples ACL 2018 The Web as a Knowledge-Base for Answering Complex Questions NAACL 2018 Polyglot Semantic Parsing in APIs NAACL 2018 Text Segmentation as a Supervised Learning Task NAACL 2018 Decoupling Structure and Lexicon for Zero-Shot Semantic Parsing EMNLP 2018 Coarse-to-Fine Question Answering for Long Documents ACL 2017 Neural Semantic Parsing over Multiple Knowledge-bases ACL 2017 Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision ACL 2017 Building a Semantic Parser Overnight ACL 2015 Building a Semantic Parser Overnight IJCNLP 2015 Modeling Biological Processes for Reading Comprehension EMNLP 2014 Semantic Parsing via Paraphrasing ACL 2014 Semantic Parsing on Freebase from Question-Answer Pairs EMNLP 2013 A Two Level Model for Context Sensitive Inference Rules ACL 2013 Learning Biological Processes with Global Constraints EMNLP 2013 Learning Verb Inference Rules from Linguistically-Motivated Evidence CONLL 2012 Efficient Tree-based Approximation for Entailment Graph Learning ACL 2012 Crowdsourcing Inference-Rule Evaluation ACL 2012 Entailment-based Text Exploration with Application to the Health-care Domain ACL 2012 Learning Verb Inference Rules from Linguistically-Motivated Evidence EMNLP 2012 Global Learning of Typed Entailment Rules ACL 2011 Recognising Entailment within Discourse COLING 2010 Global Learning of Focused Entailment Graphs ACL 2010 A Compact Forest for Scalable Inference over Entailment and Paraphrase Rules EMNLP 2009