Tal Linzen

Language Models Struggle to Use Representations Learned In-Context ACL 2026 Findings of the Third BabyLM Challenge: Accelerating Language Modeling Research with Cognitively Plausible Data EMNLP 2025 Rapid Word Learning Through Meta In-Context Learning EMNLP 2025 Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases ACL 2025 Multilingual Prompting for Improving LLM Generation Diversity EMNLP 2025 What Goes Into a LM Acceptability Judgment? Rethinking the Impact of Frequency and Length NAACL 2025 The Impact of Depth on Compositional Generalization in Transformer Language Models NAACL 2024 SPAWNing Structural Priming Predictions from a Cognitively Motivated Parser CONLL 2024 Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora CONLL 2024 In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax NAACL 2024 Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment ACL 2024 SPAWNing Structural Priming Predictions from a Cognitively Motivated Parser EMNLP 2024 A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models NAACL 2024 SLOG: A Structural Generalization Benchmark for Semantic Parsing EMNLP 2023 Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora CONLL 2023 Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora EMNLP 2023 A Language Model with Limited Memory Capacity Captures Interference in Human Sentence Processing EMNLP 2023 Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number EMNLP 2023 How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases ACL 2023 How poor is the stimulus? Evaluating hierarchical generalization in neural networks trained on child-directed speech ACL 2023 Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models CONLL 2022 Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models ACL 2022 Entailment Semantics Can Be Extracted from an Ideal Language Model CONLL 2022 Syntactic Surprisal From Neural Models Predicts, But Underestimates, Human Processing Difficulty From Syntactic Ambiguities CONLL 2022 Characterizing Verbatim Short-Term Memory in Neural Language Models CONLL 2022 Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models EMNLP 2022 Entailment Semantics Can Be Extracted from an Ideal Language Model EMNLP 2022 Syntactic Surprisal From Neural Models Predicts, But Underestimates, Human Processing Difficulty From Syntactic Ambiguities EMNLP 2022 Characterizing Verbatim Short-Term Memory in Neural Language Models EMNLP 2022 The MultiBERTs: BERT Reproductions for Robustness Analysis ICLR 2022 When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it NAACL 2022 Improving Compositional Generalization with Latent Structure and Data Augmentation NAACL 2022 Frequency Effects on Syntactic Rule Learning in Transformers EMNLP 2021 Does Putting a Linguist in the Loop Improve NLU Data Collection? EMNLP 2021 The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation EMNLP 2021 Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction EMNLP 2021 NOPE: A Corpus of Naturally-Occurring Presuppositions in English EMNLP 2021 NOPE: A Corpus of Naturally-Occurring Presuppositions in English CONLL 2021 Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction CONLL 2021 Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models ACL 2021 Predicting Inductive Biases of Pre-Trained Models ICLR 2021 Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models IJCNLP 2021 Cross-Linguistic Syntactic Evaluation of Word Prediction Models ACL 2020 How Can We Accelerate Progress Towards Human-like Linguistic Generalization? ACL 2020 COGS: A Compositional Generalization Challenge Based on Semantic Interpretation EMNLP 2020 BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance EMNLP 2020 Representations of Syntax [MASK] Useful: Effects of Constituency and Dependency Structure in Recursive LSTMs ACL 2020 Discovering the Compositional Structure of Vector Representations with Role Learning Networks EMNLP 2020 Syntactic Data Augmentation Increases Robustness to Inference Heuristics ACL 2020 Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics NAACL 2019 Quantity doesn’t buy quality syntax with neural language models EMNLP 2019 Using Priming to Uncover the Organization of Syntactic Representations in Neural Language Models CONLL 2019 Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference ACL 2019 RNNs implicitly implement tensor-product representations ICLR 2019 Quantity doesn’t buy quality syntax with neural language models IJCNLP 2019 Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP ACL 2019 Studying the Inductive Biases of RNNs with Synthetic Variations of Natural Languages NAACL 2019 Targeted Syntactic Evaluation of Language Models EMNLP 2018 A Neural Model of Adaptation in Reading EMNLP 2018 Colorless Green Recurrent Networks Dream Hierarchically NAACL 2018 Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP EMNLP 2018 Comparing Character-level Neural Language Models Using a Lexical Decision Task EACL 2017 Exploring the Syntactic Abilities of RNNs with Multi-task Learning CONLL 2017 A model of rapid phonotactic generalization EMNLP 2015