Oriol Vinyals

Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model ICLR 2024 A Practitioner's Guide to Real-World Continual Multimodal Pretraining NIPS 2024 Waffling Around for Performance: Visual Classification with Random Words and Broad Concepts ICCV 2023 Improving Language Models by Retrieving from Trillions of Tokens ICML 2022 General-purpose, long-context autoregressive modeling with Perceiver AR ICML 2022 Integrating Language Guidance Into Vision-Based Deep Metric Learning CVPR 2022 Perceiver IO: A General Architecture for Structured Inputs & Outputs ICLR 2022 Unified Scaling Laws for Routed Language Models ICML 2022 Non-Isotropy Regularization for Proxy-Based Deep Metric Learning CVPR 2022 An empirical analysis of compute-optimal large language model training NIPS 2022 Flamingo: a Visual Language Model for Few-Shot Learning NIPS 2022 Efficient Visual Pretraining With Contrastive Detection ICCV 2021 Vector Quantized Models for Planning ICML 2021 Perceiver: General Perception with Iterative Attention ICML 2021 WikiGraphs: A Wikipedia Text - Knowledge Graph Paired Dataset NAACL 2021 Multimodal Few-Shot Learning with Frozen Language Models NIPS 2021 Machine Translation Decoding beyond Beam Search EMNLP 2021 Reinforced Genetic Algorithm Learning for Optimizing Computation Graphs ICLR 2020 Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML ICLR 2020 Pointer Graph Networks NIPS 2020 Attentive Neural Processes ICLR 2019 Deep reinforcement learning with relational inductive biases ICLR 2019 Classification Accuracy Score for Conditional Generative Models NIPS 2019 Meta-Learning with Latent Embedding Optimization ICLR 2019 Graph Matching Networks for Learning the Similarity of Graph Structured Objects ICML 2019 Preventing Posterior Collapse with delta-VAEs ICLR 2019 Universal Transformers ICLR 2019 Generating Diverse High-Fidelity Images with VQ-VAE-2 NIPS 2019 Sample Efficient Adaptive Text-to-Speech ICLR 2019 Few-shot Autoregressive Density Estimation: Towards Learning to Learn Distributions ICLR 2018 Relational recurrent neural networks NIPS 2018 Memory-based Parameter Adaptation ICLR 2018 Hierarchical Representations for Efficient Architecture Search ICLR 2018 Synthesizing Programs for Images using Reinforced Adversarial Learning ICML 2018 Learning to search with MCTSnets ICML 2018 Parallel WaveNet: Fast High-Fidelity Speech Synthesis ICML 2018 Learning Implicit Generative Models with the Method of Learned Moments ICML 2018 Lip Reading Sentences in the Wild CVPR 2017 Neural Discrete Representation Learning NIPS 2017 Understanding Synthetic Gradients and Decoupled Neural Interfaces ICML 2017 Neural Message Passing for Quantum Chemistry ICML 2017 Decoupled Neural Interfaces using Synthetic Gradients ICML 2017 Video Pixel Networks ICML 2017 Neural Episodic Control ICML 2017 Imagination-Augmented Agents for Deep Reinforcement Learning NIPS 2017 Generating Sentences from a Continuous Space CONLL 2016 Multilingual Language Processing From Bytes NAACL 2016 Conditional Image Generation with PixelCNN Decoders NIPS 2016 An Online Sequence-to-Sequence Model Using Partial Conditioning NIPS 2016 Matching Networks for One Shot Learning NIPS 2016 Strategic Attentive Writer for Learning Macro-Actions NIPS 2016 Beyond Short Snippets: Deep Networks for Video Classification CVPR 2015 Addressing the Rare Word Problem in Neural Machine Translation ACL 2015 Grammar as a Foreign Language NIPS 2015 Addressing the Rare Word Problem in Neural Machine Translation IJCNLP 2015 Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks NIPS 2015 Pointer Networks NIPS 2015 Sentence Compression by Deletion with LSTMs EMNLP 2015 Show and Tell: A Neural Image Caption Generator CVPR 2015 Sequence to Sequence Learning with Neural Networks NIPS 2014 DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition ICML 2014 On Compact Codes for Spatially Pooled Features ICML 2013 Learning with Recursive Perceptual Representations NIPS 2012 Krylov Subspace Descent for Deep Learning AISTATS 2012