conftrace_

asynchronous training

22 papers

Explore in graph

Co-occurring keywords

distributed learning (563) stochastic gradient descent (1091) federated learning (1333) distributed training (188) neural network optimization (1293) data parallelism (17) gradient staleness (4) asynchronous method (4) parallel training (37) model aggregation (156)

Papers

GAS: Generative Activation-Aided Asynchronous Split Federated Learning AAAI 2025
LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation ACL 2025
Stability and Generalization of Asynchronous SGD: Sharper Bounds Beyond Lipschitz and Smoothness NIPS 2024
Weight for Robustness: A Comprehensive Approach towards Optimal Fault-Tolerant Asynchronous ML NIPS 2024
M2RL: A Multi-player Multi-agent Reinforcement Learning Framework for Complex Games IJCAI 2024
GRAWA: Gradient-based Weighted Averaging for Distributed Training of Deep Learning Models AISTATS 2024
Data Disparity and Temporal Unavailability Aware Asynchronous Federated Learning for Predictive Maintenance on Transportation Fleets AAAI 2024
FedFa: A Fully Asynchronous Training Paradigm for Federated Learning IJCAI 2024
Accelerated On-Device Forward Neural Network Training with Module-Wise Descending Asynchronism NIPS 2023
No One Idles: Efficient Heterogeneous Federated Learning with Parallel Edge and Server Computation ICML 2023
GBA: A Tuning-free Approach to Switch between Synchronous and Asynchronous Training for Recommendation Models NIPS 2022
AsyncFL: Asynchronous Federated Learning Using Majority Voting with Quantized Model Updates (Student Abstract) AAAI 2022
Accumulated Decoupled Learning with Gradient Staleness Mitigation for Convolutional Neural Networks ICML 2021
Making Asynchronous Stochastic Gradient Descent Work for Transformers EMNLP 2019
One-vs-All Models for Asynchronous Training: An Empirical Analysis INTERSPEECH 2019
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD AISTATS 2018
Master-Slave Curriculum Design for Reinforcement Learning IJCAI 2018
Fast Parallel Training of Neural Language Models IJCAI 2017
Decoupled Neural Interfaces using Synthetic Gradients ICML 2017
Speeding up Reinforcement Learning-based Information Extraction Training using Asynchronous Methods EMNLP 2017
QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding NIPS 2017
Large Scale Distributed Deep Networks NIPS 2012