conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,649 papers

Papers per year

2
5
40
414
386
'05
'10
'15
'20
'25

Papers

MetaInit: Initializing learning by learning to initialize NIPS 2019
Time Matters in Regularizing Deep Networks: Weight Decay and Data Augmentation Affect Early Learning Dynamics, Matter Little Near Convergence NIPS 2019
Memory Efficient Adaptive Optimization NIPS 2019
Computing Linear Restrictions of Neural Networks NIPS 2019
Lookahead Optimizer: k steps forward, 1 step back NIPS 2019
Neural Temporal-Difference Learning Converges to Global Optima NIPS 2019
AutoAssist: A Framework to Accelerate Training of Deep Neural Networks NIPS 2019
Continuous-time Models for Stochastic Optimization Algorithms NIPS 2019
Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics NIPS 2019
One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers NIPS 2019
Semi-flat minima and saddle points by embedding neural networks to overparameterization NIPS 2019
First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise NIPS 2019
Acceleration via Symplectic Discretization of High-Resolution Differential Equations NIPS 2019
SSRGD: Simple Stochastic Recursive Gradient Descent for Escaping Saddle Points NIPS 2019
On Lazy Training in Differentiable Programming NIPS 2019
Fixing Implicit Derivatives: Trust-Region Based Learning of Continuous Energy Functions NIPS 2019
Invertible Convolutional Flow NIPS 2019
Controlling Neural Level Sets NIPS 2019
SGD on Neural Networks Learns Functions of Increasing Complexity NIPS 2019
Gate Decorator: Global Filter Pruning Method for Accelerating Deep Convolutional Neural Networks NIPS 2019
Practical Deep Learning with Bayesian Principles NIPS 2019
Momentum-Based Variance Reduction in Non-Convex SGD NIPS 2019
RSN: Randomized Subspace Newton NIPS 2019
Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks NIPS 2019
Limitations of Lazy Training of Two-layers Neural Network NIPS 2019