← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

On the Convergence Rate of Training Recurrent Neural Networks NIPS 2019
How degenerate is the parametrization of neural networks with the ReLU activation function? NIPS 2019
Self-Attention Transducers for End-to-End Speech Recognition INTERSPEECH 2019
Layer Trajectory BLSTM INTERSPEECH 2019
Attention-Enhanced Connectionist Temporal Classification for Discrete Speech Emotion Recognition INTERSPEECH 2019
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup NIPS 2019
SGD on Neural Networks Learns Functions of Increasing Complexity NIPS 2019
Algorithm-Dependent Generalization Bounds for Overparameterized Deep Residual Networks NIPS 2019
An Improved Analysis of Training Over-parameterized Deep Neural Networks NIPS 2019
Can SGD Learn Recurrent Neural Networks with Provable Generalization? NIPS 2019
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers NIPS 2019
On Lazy Training in Differentiable Programming NIPS 2019
Practical Deep Learning with Bayesian Principles NIPS 2019
Controlling Neural Level Sets NIPS 2019
Computing Linear Restrictions of Neural Networks NIPS 2019
Time Matters in Regularizing Deep Networks: Weight Decay and Data Augmentation Affect Early Learning Dynamics, Matter Little Near Convergence NIPS 2019
Putting An End to End-to-End: Gradient-Isolated Learning of Representations NIPS 2019
Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Input NIPS 2019
Is Deeper Better only when Shallow is Good? NIPS 2019
Large Scale Structure of Neural Network Loss Landscapes NIPS 2019
Who is Afraid of Big Bad Minima? Analysis of gradient-flow in spiked matrix-tensor models NIPS 2019
Dimension-Free Bounds for Low-Precision Training NIPS 2019
Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification and Local Computations NIPS 2019
Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks NIPS 2019
Universal Approximation of Input-Output Maps by Temporal Convolutional Nets NIPS 2019