conftrace_

mini-batch sgd

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

local sgd (3) stochastic gradient descent (3) communication efficiency (2) distributed optimization (2) distributed learning (2) worker heterogeneity (1) stochastic variance (1) quadratic objective (1) min-max optimality (1) large language model (1)

Papers

Training with Fewer Bits: Unlocking Edge LLMs Training with Stochastic Rounding EMNLP 2025 AsGrad: A Sharp Unified Analysis of Asynchronous-SGD Algorithms AISTATS 2024 The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication COLT 2024 Accelerating Stratified Sampling SGD by Reconstructing Strata IJCAI 2020 Don't Use Large Mini-batches, Use Local SGD ICLR 2020 Is Local SGD Better than Minibatch SGD? ICML 2020