Felix Hill

Strategy Coopetition Explains the Emergence and Transience of In-Context Learning ICML 2025 SODA: Bottleneck Diffusion Models for Representation Learning CVPR 2024 What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation ICML 2024 Know your audience: specializing grounded language models with listener subtraction EACL 2023 SemPPL: Predicting Pseudo-Labels for Better Contrastive Representations ICLR 2023 The Edge of Orthogonality: A Simple View of What Makes BYOL Tick ICML 2023 The Transient Nature of Emergent In-Context Learning in Transformers NeurIPS 2023 Can language models learn from explanations in context? EMNLP 2022 Data Distributional Properties Drive Emergent In-Context Learning in Transformers NeurIPS 2022 Semantic Exploration from Language Abstractions and Pretrained Representations NeurIPS 2022 Tell me why! Explanations support learning relational and causal structure ICML 2022 Attention over Learned Object Embeddings Enables Complex Visual Reasoning NeurIPS 2021 Grounded Language Learning Fast and Slow ICLR 2021 Multimodal Few-Shot Learning with Frozen Language Models NeurIPS 2021 Towards mental time travel: a hierarchical memory for reinforcement learning agents NeurIPS 2021 Environmental drivers of systematicity and generalization in a situated agent ICLR 2020 Probing Emergent Semantics in Predictive Agents via Question Answering ICML 2020 Analysing Mathematical Reasoning Abilities of Neural Models ICLR 2019 GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding ICLR 2019 Higher-order Comparisons of Sentence Encoder Representations EMNLP 2019 Learning to Make Analogies by Contrasting Abstract Relational Structure ICLR 2019 Learning to Understand Goal Specifications by Modelling Reward ICLR 2019 SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems NeurIPS 2019 GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding EMNLP 2018 Measuring abstract reasoning in neural networks ICML 2018 Neural Arithmetic Logic Units NeurIPS 2018 Proceedings of the Third Workshop on Representation Learning for NLP ACL 2018 Learning Distributed Representations of Sentences from Unlabelled Data NAACL 2016 SimVerb-3500: A Large-Scale Evaluation Set of Verb Similarity EMNLP 2016 Specializing Word Embeddings for Similarity or Relatedness EMNLP 2015 Concreteness and Subjectivity as Dimensions of Lexical Meaning ACL 2014 Improving Multi-Modal Representations Using Image Dispersion: Why Less is Sometimes More ACL 2014 Learning Abstract Concept Embeddings from Multi-Modal Data: Since You Probably Can’t See What I Mean EMNLP 2014 Beauty Before Age? Applying Subjectivity to Automatic English Adjective Ordering NAACL 2012