conftrace_

model convergence

39 papers

Explore in graph

Co-occurring keywords

federated learning (1333) distributed learning (563) stochastic gradient descent (1091) data heterogeneity (115) neural network optimization (1293) image generation (2073) non-iid datum (109) large language model (13587) deep neural network (1803) model aggregation (156)

Papers

Efficient Dynamic Batch Adaptation (Student Abstract) AAAI 2023
FedDC: Federated Learning With Non-IID Data via Local Drift Decoupling and Correction CVPR 2022
HarmoFL: Harmonizing Local and Global Drifts in Federated Learning on Heterogeneous Medical Images AAAI 2022
Tricks for Training Sparse Translation Models NAACL 2022
Boost Neural Networks by Checkpoints NIPS 2021
Asynchronous Stochastic Gradient Descent for Extreme-Scale Recommender Systems AAAI 2021
SnapBoost: A Heterogeneous Boosting Machine NIPS 2020
Is normalization indispensable for training deep neural network? NIPS 2020
Revisit Batch Normalization: New Understanding and Refinement via Composition Optimization AISTATS 2019
Making Asynchronous Stochastic Gradient Descent Work for Transformers EMNLP 2019
Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training IJCNLP 2019
Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention EMNLP 2019
Can We Gain More from Orthogonality Regularizations in Training Deep Networks? NIPS 2018
Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation EMNLP 2018