Oriol Vinyals

A Practitioner's Guide to Real-World Continual Multimodal Pretraining NeurIPS 2024 Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model ICLR 2024 Waffling Around for Performance: Visual Classification with Random Words and Broad Concepts ICCV 2023 An empirical analysis of compute-optimal large language model training NeurIPS 2022 Flamingo: a Visual Language Model for Few-Shot Learning NeurIPS 2022 General-purpose, long-context autoregressive modeling with Perceiver AR ICML 2022 Improving Language Models by Retrieving from Trillions of Tokens ICML 2022 Integrating Language Guidance Into Vision-Based Deep Metric Learning CVPR 2022 Non-Isotropy Regularization for Proxy-Based Deep Metric Learning CVPR 2022 Perceiver IO: A General Architecture for Structured Inputs & Outputs ICLR 2022 Unified Scaling Laws for Routed Language Models ICML 2022 Efficient Visual Pretraining With Contrastive Detection ICCV 2021 Machine Translation Decoding beyond Beam Search EMNLP 2021 Multimodal Few-Shot Learning with Frozen Language Models NeurIPS 2021 Perceiver: General Perception with Iterative Attention ICML 2021 Vector Quantized Models for Planning ICML 2021 WikiGraphs: A Wikipedia Text - Knowledge Graph Paired Dataset NAACL 2021 Pointer Graph Networks NeurIPS 2020 Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML ICLR 2020 Reinforced Genetic Algorithm Learning for Optimizing Computation Graphs ICLR 2020 Attentive Neural Processes ICLR 2019 Classification Accuracy Score for Conditional Generative Models NeurIPS 2019 Deep reinforcement learning with relational inductive biases ICLR 2019 Generating Diverse High-Fidelity Images with VQ-VAE-2 NeurIPS 2019 Graph Matching Networks for Learning the Similarity of Graph Structured Objects ICML 2019 Meta-Learning with Latent Embedding Optimization ICLR 2019 Preventing Posterior Collapse with delta-VAEs ICLR 2019 Sample Efficient Adaptive Text-to-Speech ICLR 2019 Universal Transformers ICLR 2019 Few-shot Autoregressive Density Estimation: Towards Learning to Learn Distributions ICLR 2018 Hierarchical Representations for Efficient Architecture Search ICLR 2018 Learning Implicit Generative Models with the Method of Learned Moments ICML 2018 Learning to search with MCTSnets ICML 2018 Memory-based Parameter Adaptation ICLR 2018 Parallel WaveNet: Fast High-Fidelity Speech Synthesis ICML 2018 Relational recurrent neural networks NeurIPS 2018 Synthesizing Programs for Images using Reinforced Adversarial Learning ICML 2018 Decoupled Neural Interfaces using Synthetic Gradients ICML 2017 Imagination-Augmented Agents for Deep Reinforcement Learning NeurIPS 2017 Lip Reading Sentences in the Wild CVPR 2017 Neural Discrete Representation Learning NeurIPS 2017 Neural Episodic Control ICML 2017 Neural Message Passing for Quantum Chemistry ICML 2017 Understanding Synthetic Gradients and Decoupled Neural Interfaces ICML 2017 Video Pixel Networks ICML 2017 An Online Sequence-to-Sequence Model Using Partial Conditioning NeurIPS 2016 Conditional Image Generation with PixelCNN Decoders NeurIPS 2016 Generating Sentences from a Continuous Space CoNLL 2016 Matching Networks for One Shot Learning NeurIPS 2016 Multilingual Language Processing From Bytes NAACL 2016 Strategic Attentive Writer for Learning Macro-Actions NeurIPS 2016 Addressing the Rare Word Problem in Neural Machine Translation ACL 2015 Beyond Short Snippets: Deep Networks for Video Classification CVPR 2015 Grammar as a Foreign Language NeurIPS 2015 Pointer Networks NeurIPS 2015 Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks NeurIPS 2015 Sentence Compression by Deletion with LSTMs EMNLP 2015 Show and Tell: A Neural Image Caption Generator CVPR 2015 DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition ICML 2014 Sequence to Sequence Learning with Neural Networks NeurIPS 2014 On Compact Codes for Spatially Pooled Features ICML 2013 Krylov Subspace Descent for Deep Learning AISTATS 2012 Learning with Recursive Perceptual Representations NeurIPS 2012