← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

Metatrace Actor-Critic: Online Step-Size Tuning by Meta-gradient Descent for Reinforcement Learning Control IJCAI 2019
The Effect of Network Width on Stochastic Gradient Descent and Generalization: an Empirical Study ICML 2019
Fairness-Aware Learning for Continuous Attributes and Treatments ICML 2019
Anytime Online-to-Batch, Optimism and Acceleration ICML 2019
Projection-Free Bandit Convex Optimization AISTATS 2019
Local Saddle Point Optimization: A Curvature Exploitation Approach AISTATS 2019
Graph Policy Gradients for Large Scale Robot Control CORL 2019
On the Convergence of Stochastic Gradient Descent with Adaptive Stepsizes AISTATS 2019
Fisher Information and Natural Gradient Learning in Random Deep Networks AISTATS 2019
InteractionNN: A Neural Network for Learning Hidden Features in Sparse Prediction IJCAI 2019
Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach AISTATS 2019
The Role of Memory in Stochastic Optimization UAI 2019
A Quantitative Analysis of the Effect of Batch Normalization on Gradient Descent ICML 2019
An Empirical Investigation of Global and Local Normalization for Recurrent Neural Sequence Models Using a Continuous Relaxation to Beam Search NAACL 2019
Positional Encoding to Control Output Sequence Length NAACL 2019
IRLAS: Inverse Reinforcement Learning for Architecture Search CVPR 2019
Efficient Full-Matrix Adaptive Regularization ICML 2019
Towards Robust ResNet: A Small Step but a Giant Leap IJCAI 2019
On the Convergence of (Stochastic) Gradient Descent with Extrapolation for Non-Convex Minimization IJCAI 2019
Heavy-ball Algorithms Always Escape Saddle Points IJCAI 2019
Adaptively Truncating Backpropagation Through Time to Control Gradient Bias UAI 2019
SSRGD: Simple Stochastic Recursive Gradient Descent for Escaping Saddle Points NIPS 2019
Continuous-time Models for Stochastic Optimization Algorithms NIPS 2019
Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel NIPS 2019
The Goldilocks Zone: Towards Better Understanding of Neural Network Loss Landscapes AAAI 2019