gradient descent

Singleshot : a scalable Tucker tensor decomposition NeurIPS 2019 Sobolev Independence Criterion NeurIPS 2019 Spurious Valleys in One-hidden-layer Neural Network Optimization Landscapes JMLR 2019 Stochastic Iterative Hard Thresholding for Graph-structured Sparsity Optimization ICML 2019 Surfing: Iterative Optimization Over Incrementally Trained Deep Networks NeurIPS 2019 The Complexity of Making the Gradient Small in Stochastic Convex Optimization COLT 2019 The Convergence Rate of Neural Networks for Learned Functions of Different Frequencies NeurIPS 2019 The implicit bias of gradient descent on nonseparable data COLT 2019 Theoretical Limits of Pipeline Parallel Optimization and Application to Distributed Deep Learning NeurIPS 2019 The Role of Memory in Stochastic Optimization UAI 2019 Tight Sample Complexity of Learning One-hidden-layer Convolutional Neural Networks NeurIPS 2019 Time/Accuracy Tradeoffs for Learning a ReLU with respect to Gaussian Marginals NeurIPS 2019 Towards Understanding the Generalization Bias of Two Layer Convolutional Linear Classifiers with Gradient Descent AISTATS 2019 Towards Understanding the Importance of Shortcut Connections in Residual Networks NeurIPS 2019 Toward Understanding the Importance of Noise in Training Neural Networks ICML 2019 Trivializations for Gradient-Based Optimization on Manifolds NeurIPS 2019 Ultrametric Fitting by Gradient Descent NeurIPS 2019 Understanding Straight-Through Estimator in Training Activation Quantized Neural Nets ICLR 2019 Uniform convergence may be unable to explain generalization in deep learning NeurIPS 2019 Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Input NeurIPS 2019 Who is Afraid of Big Bad Minima? Analysis of gradient-flow in spiked matrix-tensor models NeurIPS 2019 Why do Larger Models Generalize Better? A Theoretical Perspective via the XOR Problem ICML 2019 Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent NeurIPS 2019 Width Provably Matters in Optimization for Deep Linear Neural Networks ICML 2019 Activation Maximization Generative Adversarial Nets ICLR 2018