← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

On Variance Reduction in Stochastic Gradient Descent and its Asynchronous Variants NIPS 2015
End-to-end Learning of LDA by Mirror-Descent Back Propagation over a Deep Architecture NIPS 2015
Averaged Least-Mean-Squares: Bias-Variance Trade-offs and Optimal Sampling Distributions AISTATS 2015
Global Convergence of Online Limited Memory BFGS JMLR 2015
Training Very Deep Networks NIPS 2015
See the Difference: Direct Pre-Image Reconstruction and Pose Estimation by Differentiating HOG ICCV 2015
Global Convergence of Stochastic Gradient Descent for Some Non-convex Matrix Problems ICML 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift ICML 2015
The Loss Surfaces of Multilayer Networks AISTATS 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification ICCV 2015
A Lower Bound for the Optimization of Finite Sums ICML 2015
Scaling up Natural Gradient by Sparsely Factorizing the Inverse Fisher Matrix ICML 2015
Gradient-based Hyperparameter Optimization through Reversible Learning ICML 2015
Optimizing Neural Networks with Kronecker-factored Approximate Curvature ICML 2015
Deeply-Supervised Nets AISTATS 2015
An Empirical Exploration of Recurrent Network Architectures ICML 2015
Open Problem: The landscape of the loss surfaces of multilayer networks COLT 2015
Accelerated Mirror Descent in Continuous and Discrete Time NIPS 2015
Deep LAC: Deep Localization, Alignment and Classification for Fine-Grained Recognition CVPR 2015
From Averaging to Acceleration, There is Only a Step-size COLT 2015
Stochastic Spectral Descent for Restricted Boltzmann Machines AISTATS 2015
SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives NIPS 2014
Online and Stochastic Gradient Methods for Non-decomposable Loss Functions NIPS 2014
Max-Margin Infinite Hidden Markov Models ICML 2014
Fast Stochastic Alternating Direction Method of Multipliers ICML 2014