conftrace_

pseudo gradient penalty

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

layer-wise parameter synchronization (1) model sharding (1) local sgd (1) communication overhead (1) asynchronous training (1)

Papers

EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models ICLR 2025