conftrace_

layer-wise parameter synchronization

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

pseudo gradient penalty (1) model sharding (1) local sgd (1) communication overhead (1) asynchronous training (1)

Papers

EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models ICLR 2025