← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

Towards Better Generalization of Adaptive Gradient Methods NIPS 2020
On the Almost Sure Convergence of Stochastic Gradient Descent in Non-Convex Problems NIPS 2020
MomentumRNN: Integrating Momentum into Recurrent Neural Networks NIPS 2020
Parabolic Approximation Line Search for DNNs NIPS 2020
Reparameterizing Mirror Descent as Gradient Descent NIPS 2020
Bad Global Minima Exist and SGD Can Reach Them NIPS 2020
The Pitfalls of Simplicity Bias in Neural Networks NIPS 2020
Understanding Approximate Fisher Information for Fast Convergence of Natural Gradient Descent in Wide Neural Networks NIPS 2020
Proximal Mapping for Deep Regularization NIPS 2020
Global Convergence of Deep Networks with One Wide Layer Followed by Pyramidal Topology NIPS 2020
Improving Neural Network Training in Low Dimensional Random Bases NIPS 2020
CSER: Communication-efficient SGD with Error Reset NIPS 2020
Learning compositional functions via multiplicative weight updates NIPS 2020
A Generalized Neural Tangent Kernel Analysis for Two-layer Neural Networks NIPS 2020
Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions NIPS 2020
Improved Analysis of Clipping Algorithms for Non-convex Optimization NIPS 2020
Bayesian filtering unifies adaptive and non-adaptive neural network optimization methods NIPS 2020
Logarithmic Pruning is All You Need NIPS 2020
The Lottery Ticket Hypothesis for Pre-trained BERT Networks NIPS 2020
Stable and expressive recurrent vision models NIPS 2020
Simulating a Primary Visual Cortex at the Front of CNNs Improves Robustness to Image Perturbations NIPS 2020
AutoTrack: Towards High-Performance Visual Tracking for UAV With Automatic Spatio-Temporal Regularization CVPR 2020
A Lyapunov analysis for accelerated gradient methods: from deterministic to stochastic case AISTATS 2020
Elimination of All Bad Local Minima in Deep Learning AISTATS 2020
On the Convergence Theory of Gradient-Based Model-Agnostic Meta-Learning Algorithms AISTATS 2020