spectral model sharding

unbiased estimator (1) parameter partitioning (1) on-device training (1) approximation error (1) low-rank matrix (1) singular value decomposition (1) distributed optimization (1) sampling strategy (1) federated learning (1) model compression (1)