neural network optimization

Train faster, generalize better: Stability of stochastic gradient descent ICML 2016 Training Region-Based Object Detectors With Online Hard Example Mining CVPR 2016 BinaryConnect: Training Deep Neural Networks with binary weights during propagations NeurIPS 2015 Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification ICCV 2015 Path-SGD: Path-Normalized Optimization in Deep Neural Networks NeurIPS 2015 Preconditioned Spectral Descent for Deep Learning NeurIPS 2015 Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation NeurIPS 2014 On the Computational Efficiency of Training Neural Networks NeurIPS 2014 On the importance of initialization and momentum in deep learning ICML 2013 TD_gamma: Re-evaluating Complex Backups in Temporal Difference Learning NeurIPS 2011 An analysis on negative curvature induced by singularity in multi-layer neural-network learning NeurIPS 2010 Understanding the difficulty of training deep feedforward neural networks AISTATS 2010