Adam Roberts
23 papers · 2017–2025 · 7 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+9 more ↓ Show less ↑
🗺️ Taxonomy Completionist (37) 🏃 Academic Marathon · Sprint 🌍 Conference Polyglot · Silver 🌉 Interdisciplinary Bridge · Silver 🐣 Hot Topic Early Bird
🔬
Deep Specialist
(10)
👥
Mega-Team · Legion
🚀
Conference Pioneer
🔥
Unstoppable · Bronze
❓
The Questioner
(3)
⚡
Prolific Year · Productive
💎
Century Club · Bronze
🌈
Renaissance Researcher
(5)
🗃️
Keyword Collector
(90)
Top co-authors
Research topics
Deep Learning
(17)
Models
(13)
Artificial Intelligence
(11)
Natural Language Processing
(10)
Core AI
(8)
Resources & Methods
(7)
Machine Learning
(6)
Architectures
(5)
Generation
(4)
Learning Types · Machine Learning
(4)
Learning Paradigms
(3)
Techniques
(3)
Applications
(2)
Learning Types · Deep Learning
(2)
Optimization & Theory
(2)
Keywords
large language model
(6)
language model
(4)
audio synthesis
(3)
music generation
(3)
generative model
(3)
variational autoencoder
(2)
pretraining data
(2)
transfer learning
(2)
transformer architecture
(2)
question answering
(2)
model scaling
(2)
few-shot learning
(2)
zero-shot generalization
(2)
neural network
(2)
instruction tuning
(1)
multilingual pretraining
(1)
gradient-based optimization
(1)
distributed computing
(1)
conditional generation
(1)
zero-shot learning
(1)
Papers
Live Music Models
NeurIPS 2025
Adaptive Accompaniment with ReaLchords
ICML 2024
A Pretrainer’s Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity
NAACL 2024
Scaling Instruction-Finetuned Language Models
JMLR 2024
Character-Aware Models Improve Visual Text Rendering
ACL 2023
Crosslingual Generalization through Multitask Finetuning
ACL 2023
Large Language Models Struggle to Learn Long-Tail Knowledge
ICML 2023
PaLM: Scaling Language Modeling with Pathways
JMLR 2023
Scaling Up Models and Data with t5x and seqio
JMLR 2023
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
ICML 2023
UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining
ICLR 2023
What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?
ICML 2022
Do Transformer Modifications Transfer Across Implementations and Applications?
EMNLP 2021
mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer
NAACL 2021
DDSP: Differentiable Digital Signal Processing
ICLR 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
JMLR 2020
How Much Knowledge Can You Pack Into the Parameters of a Language Model?
EMNLP 2020
Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset
ICLR 2019
GANSynth: Adversarial Neural Audio Synthesis
ICLR 2019
Learning to Groove with Inverse Sequence Transformations
ICML 2019
A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music
ICML 2018
Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models
ICLR 2018
Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders
ICML 2017