conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Train faster, generalize better: Stability of stochastic gradient descent ICML 2016
Refining Architectures of Deep Convolutional Neural Networks CVPR 2016
Optimal Architectures in a Solvable Model of Deep Networks NIPS 2016
A Theoretically Grounded Application of Dropout in Recurrent Neural Networks NIPS 2016
CNNpack: Packing Convolutional Neural Networks in the Frequency Domain NIPS 2016
Noisy Activation Functions ICML 2016
Learning to learn by gradient descent by gradient descent NIPS 2016
Dynamic Network Surgery for Efficient DNNs NIPS 2016
Preconditioned Spectral Descent for Deep Learning NIPS 2015
BinaryConnect: Training Deep Neural Networks with binary weights during propagations NIPS 2015
Path-SGD: Path-Normalized Optimization in Deep Neural Networks NIPS 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification ICCV 2015
On the Computational Efficiency of Training Neural Networks NIPS 2014
Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation NIPS 2014
On the importance of initialization and momentum in deep learning ICML 2013
TD_gamma: Re-evaluating Complex Backups in Temporal Difference Learning NIPS 2011
An analysis on negative curvature induced by singularity in multi-layer neural-network learning NIPS 2010
Understanding the difficulty of training deep feedforward neural networks AISTATS 2010