Olatunji Ruwase
3 papers · 2021–2024 · 2 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓
🌍
Conference Polyglot · Bronze
🌉
Interdisciplinary Bridge · Bronze
Venues
Top co-authors
Research topics
Keywords
model quantization
(1)
attention mechanism
(1)
distributed learning
(1)
neural network optimization
(1)
model training
(1)
positional encoding
(1)
collective communication
(1)
long context
(1)
context fusion
(1)
batch size
(1)
large-scale training
(1)
gradient similarity
(1)
rotary positional embedding
(1)
large language model
(1)
adaptive batching
(1)
Papers
Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
NeurIPS 2024
ZeRO++: Extremely Efficient Collective Communication for Large Model Training
ICLR 2024
SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement
NeurIPS 2021