Sumit Sanghai
9 papers · 2020–2024 · 6 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+2 more ↓ Show less ↑
π§ Keyword Pioneer π Cross-Pollinator (3) πΊοΈ Taxonomy Completionist (25) π Interdisciplinary Bridge π Conference Polyglot (6)
β‘
Prolific Year
(5)
β
The Questioner
Conferences
EMNLP (3)
ICML (2)
ACL (1)
COLING (1)
ICLR (1)
NAACL (1)
Top co-authors
Keywords
retrieval augmentation
(2)
transformer architecture
(2)
language model
(2)
machine translation
(1)
semantic parsing
(1)
long-range transformers
(1)
text generation
(1)
low-resource learning
(1)
efficient inference
(1)
efficient computing
(1)
vector quantization
(1)
memory efficiency
(1)
variational autoencoder
(1)
feedforward network
(1)
inference optimization
(1)
conditional computation
(1)
retrieval-augmented generation
(1)
question answering
(1)
beam search
(1)
model compression
(1)
Papers
MEMORY-VQ: Compression for Tractable Internet-Scale Memory
NAACL 2024
Functional Interpolation for Relative Positions improves Long Context Transformers
ICLR 2024
FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference
ACL 2023
CoLT5: Faster Long-Range Transformers with Conditional Computation
EMNLP 2023
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
EMNLP 2023
Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute
ICML 2023
Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
ICML 2023
Generate-and-Retrieve: Use Your Predictions to Improve Retrieval for Semantic Parsing
COLING 2022
ETC: Encoding Long and Structured Inputs in Transformers
EMNLP 2020