Adam Roberts
22 papers · 2017–2024 · 6 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+11 more ↓ Show less ↑
π Interdisciplinary Bridge π Renaissance Researcher (6) π Academic Marathon (7) π Conference Polyglot (6) πΊοΈ Taxonomy Completionist (31)
πΊοΈ
Taxonomy Completionist
(31)
π§
Keyword Pioneer
π£
Hot Topic Early Bird
π§¬
Topic Evolution
π₯
Mega-Team
(67)
π
Conference Pioneer
π
Century Club
(22)
ποΈ
Keyword Collector
(65)
π₯
Unstoppable
(8)
β
The Questioner
(3)
β‘
Prolific Year
(7)
Conferences
ICML (7)
ICLR (5)
JMLR (4)
ACL (2)
EMNLP (2)
NAACL (2)
Top co-authors
Keywords
large language model
(5)
language model
(4)
music generation
(2)
few-shot learning
(2)
question answering
(2)
transformer architecture
(2)
model scaling
(2)
transfer learning
(2)
zero-shot generalization
(2)
variational autoencoder
(1)
latent representation
(1)
diffusion model
(1)
cross-lingual transfer
(1)
generative model
(1)
instruction tuning
(1)
data quality
(1)
distributed computing
(1)
text-to-image model
(1)
variational information bottleneck
(1)
prompt engineering
(1)
Papers
Scaling Instruction-Finetuned Language Models
JMLR 2024
Adaptive Accompaniment with ReaLchords
ICML 2024
A Pretrainerβs Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity
NAACL 2024
Crosslingual Generalization through Multitask Finetuning
ACL 2023
Character-Aware Models Improve Visual Text Rendering
ACL 2023
UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining
ICLR 2023
Large Language Models Struggle to Learn Long-Tail Knowledge
ICML 2023
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
ICML 2023
PaLM: Scaling Language Modeling with Pathways
JMLR 2023
Scaling Up Models and Data with t5x and seqio
JMLR 2023
What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?
ICML 2022
mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer
NAACL 2021
Do Transformer Modifications Transfer Across Implementations and Applications?
EMNLP 2021
DDSP: Differentiable Digital Signal Processing
ICLR 2020
How Much Knowledge Can You Pack Into the Parameters of a Language Model?
EMNLP 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
JMLR 2020
Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset
ICLR 2019
GANSynth: Adversarial Neural Audio Synthesis
ICLR 2019
Learning to Groove with Inverse Sequence Transformations
ICML 2019
A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music
ICML 2018
Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models
ICLR 2018
Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders
ICML 2017