Samyam Rajbhandari
6 papers · 2018–2025 · 4 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+3 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (15) π Interdisciplinary Bridge π§ Keyword Pioneer π Conference Polyglot (4) π Academic Marathon (7)
π£
Hot Topic Early Bird
π
Cross-Pollinator
(12)
π
Conference Pioneer
Conferences
ICLR (2)
ICML (2)
EMNLP (1)
NIPS (1)
Top co-authors
Keywords
large language model
(3)
model compression
(3)
inference optimization
(2)
neural network optimization
(1)
distributed training
(1)
model inference
(1)
training efficiency
(1)
sparse model
(1)
adaptive optimization
(1)
adam optimizer
(1)
communication compression
(1)
mixture of expert
(1)
kv cache
(1)
batch size
(1)
error compensation
(1)
key-value cache compression
(1)
gradient similarity
(1)
prefill optimization
(1)
model transformation
(1)
large scale training
(1)
Papers
SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation
EMNLP 2025
ZeRO++: Extremely Efficient Collective Communication for Large Model Training
ICLR 2024
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
ICML 2022
SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement
NIPS 2021
1-bit Adam: Communication Efficient Large-Scale Training with Adamβs Convergence Speed
ICML 2021
Learning Intrinsic Sparse Structures within Long Short-Term Memory
ICLR 2018