Samyam Rajbhandari
6 papers · 2018–2025 · 4 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
🌍 Conference Polyglot · Bronze 🏃 Academic Marathon · Sprint 🌉 Interdisciplinary Bridge · Bronze 🗺️ Taxonomy Completionist (16) 🐣 Hot Topic Early Bird
🚀
Conference Pioneer
Venues
Top co-authors
Research topics
Machine Learning
(6)
Application Areas
(5)
Deep Learning
(4)
Optimization & Theory · Machine Learning
(4)
Optimization & Theory · Deep Learning
(3)
Architectures
(2)
Artificial Intelligence
(1)
Natural Language Processing
(1)
Core AI
(1)
Learning Types
(1)
Models
(1)
Resources & Methods
(1)
Techniques
(1)
Keywords
model compression
(4)
large language model
(3)
inference optimization
(2)
knowledge distillation
(1)
language modeling
(1)
distributed learning
(1)
neural network optimization
(1)
group lasso
(1)
distributed training
(1)
model inference
(1)
training efficiency
(1)
sparse model
(1)
sparse structure
(1)
long short-term memory
(1)
adaptive optimization
(1)
adam optimizer
(1)
model training
(1)
communication compression
(1)
mixture of expert
(1)
collective communication
(1)
Papers
SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation
EMNLP 2025
ZeRO++: Extremely Efficient Collective Communication for Large Model Training
ICLR 2024
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
ICML 2022
1-bit Adam: Communication Efficient Large-Scale Training with Adam’s Convergence Speed
ICML 2021
SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement
NeurIPS 2021
Learning Intrinsic Sparse Structures within Long Short-Term Memory
ICLR 2018