stochastic gradient descent

Fall of Empires: Breaking Byzantine-tolerant SGD by Inner Product Manipulation UAI 2019 Fast and Accurate Stochastic Gradient Estimation NeurIPS 2019 Fast and Faster Convergence of SGD for Over-Parameterized Models and an Accelerated Perceptron AISTATS 2019 Faster Distributed Deep Net Training: Computation and Communication Decoupled Stochastic Gradient Descent IJCAI 2019 Feature Grouping as a Stochastic Regularizer for High-Dimensional Structured Data ICML 2019 Fine-grained Optimization of Deep Neural Networks NeurIPS 2019 First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise NeurIPS 2019 Fixing Mini-batch Sequences with Hierarchical Robust Partitioning AISTATS 2019 Fluctuation-dissipation relations for stochastic gradient descent ICLR 2019 Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks NeurIPS 2019 G-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space ICLR 2019 Inverse Path Tracing for Joint Material and Lighting Estimation CVPR 2019 Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models NeurIPS 2019 Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers NeurIPS 2019 Learning Ising Models with Independent Failures COLT 2019 Learning One-hidden-layer Neural Networks under General Input Distributions AISTATS 2019 Learning-to-Learn Stochastic Gradient Descent with Biased Regularization ICML 2019 Learning with Non-Convex Truncated Losses by SGD UAI 2019 Local SGD with Periodic Averaging: Tighter Analysis and Adaptive Synchronization NeurIPS 2019 Lookahead Optimizer: k steps forward, 1 step back NeurIPS 2019 Making Asynchronous Stochastic Gradient Descent Work for Transformers EMNLP 2019 Making the Last Iterate of SGD Information Theoretically Optimal COLT 2019 Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit COLT 2019 Memory Efficient Adaptive Optimization NeurIPS 2019 Meta-Descent for Online, Continual Prediction AAAI 2019