conftrace_

mini-batch sgd

3 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) worker heterogeneity (2) stochastic variance (6) large language model (13587) stochastic rounding (4) quantized training (13) llm training (4) surrogate bound (2) heterogeneous setting (3) asynchronous learning (26)

Papers

Training with Fewer Bits: Unlocking Edge LLMs Training with Stochastic Rounding EMNLP 2025
AsGrad: A Sharp Unified Analysis of Asynchronous-SGD Algorithms AISTATS 2024
Accelerating Stratified Sampling SGD by Reconstructing Strata IJCAI 2020