Piotr Nawrot
5 papers · 2022–2024 · 5 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓
🌍
Conference Polyglot
(5)
🌉
Interdisciplinary Bridge
🗺️
Taxonomy Completionist
(10)
🐣
Hot Topic Early Bird
🐝
Cross-Pollinator
(14)
Conferences
ACL (1)
EMNLP (1)
ICML (1)
NAACL (1)
NIPS (1)
Top co-authors
Keywords
sequence modeling
(2)
transformer architecture
(1)
efficient training
(1)
autoregressive generation
(1)
language modeling
(1)
efficient computing
(1)
batch selection
(1)
dynamic pooling
(1)
learning rate decay
(1)
language model
(1)
model pre-training
(1)
model efficiency
(1)
hierarchical architecture
(1)
text-to-text transfer transformer
(1)
dynamic architecture
(1)
t5 model
(1)
transformer model
(1)
layer dropping
(1)
model compression
(1)
computation budget
(1)
Papers
Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference
ICML 2024
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
NIPS 2023
Efficient Transformers with Dynamic Token Pooling
ACL 2023
nanoT5: Fast & Simple Pre-training and Fine-tuning of T5 Models with Limited Resources
EMNLP 2023
Hierarchical Transformers Are More Efficient Language Models
NAACL 2022