LUKASZ KAISER
13 papers · 2015–2022 · 6 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+7 more ↓ Show less ↑
🌍 Conference Polyglot (6) 🌉 Interdisciplinary Bridge 🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🏃 Academic Marathon (7)
🌉
Interdisciplinary Bridge
🧭
Keyword Pioneer
🐣
Hot Topic Early Bird
🚀
Conference Pioneer
💎
Century Club
(13)
🔥
Unstoppable
(5)
⚡
Prolific Year
(6)
Conferences
ICLR (6)
ICML (3)
ACL (1)
EMNLP (1)
NAACL (1)
NIPS (1)
Top co-authors
Keywords
neural machine translation
(4)
transformer model
(2)
autoregressive model
(2)
language modeling
(2)
image captioning
(1)
model architecture
(1)
efficient inference
(1)
image super-resolution
(1)
convolutional neural network
(1)
recurrent neural network
(1)
model ensemble
(1)
sequence model
(1)
discrete latent variable
(1)
sparse attention
(1)
multi-head attention
(1)
model efficiency
(1)
hybrid model
(1)
hierarchical architecture
(1)
sequence-to-sequence model
(1)
sequence to sequence
(1)
Papers
Hierarchical Transformers Are More Efficient Language Models
NAACL 2022
Sparse is Enough in Scaling Transformers
NIPS 2021
Rethinking Attention with Performers
ICLR 2021
Reformer: The Efficient Transformer
ICLR 2020
Universal Transformers
ICLR 2019
Area Attention
ICML 2019
The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation
ACL 2018
Fast Decoding in Sequence Models Using Discrete Latent Variables
ICML 2018
Image Transformer
ICML 2018
Generating Wikipedia by Summarizing Long Sequences
ICLR 2018
Unsupervised Cipher Cracking Using Discrete GANs
ICLR 2018
Depthwise Separable Convolutions for Neural Machine Translation
ICLR 2018
Sentence Compression by Deletion with LSTMs
EMNLP 2015