conftrace_
← Deep Learning
Deep Learning ›

Optimization & Theory

6,829 papers (27 classified directly here)

Subtopics

Model Compression (1,785) Optimization (1,664) Efficient Computing (1,579) Theory (1,082) Neural Network Optimization (903) Evaluation (509) Loss Functions (123) Interpretability (105) Stochastic Methods (97) Regularization (77) Generalization (24) Sparse Optimization (7)

Papers per year

8
50
642
1173
'10
'15
'20
'25

Papers (including subtopics)

Less is More: Nyström Computational Regularization NIPS 2015
Backpropagation for Energy-Efficient Neuromorphic Computing NIPS 2015
Randomized Block Krylov Methods for Stronger and Faster Approximate Singular Value Decomposition NIPS 2015
Training Very Deep Networks NIPS 2015
BinaryConnect: Training Deep Neural Networks with binary weights during propagations NIPS 2015
Asynchronous Parallel Stochastic Gradient for Nonconvex Optimization NIPS 2015
Spectral Representations for Convolutional Neural Networks NIPS 2015
Tensorizing Neural Networks NIPS 2015
Scale Up Nonlinear Component Analysis with Doubly Stochastic Gradients NIPS 2015
Efficient Exact Gradient Update for training Deep Networks with Very Large Sparse Targets NIPS 2015
Structured Transforms for Small-Footprint Deep Learning NIPS 2015
Improved Iteration Complexity Bounds of Cyclic Block Coordinate Descent for Convex Problems NIPS 2015
Taming the Wild: A Unified Analysis of Hogwild-Style Algorithms NIPS 2015
A Complete Recipe for Stochastic Gradient MCMC NIPS 2015
StopWasting My Gradients: Practical SVRG NIPS 2015
Hessian-free Optimization for Learning Deep Multidimensional Recurrent Neural Networks NIPS 2015
Learning both Weights and Connections for Efficient Neural Network NIPS 2015
Robust PCA with compressed data NIPS 2015
On Variance Reduction in Stochastic Gradient Descent and its Asynchronous Variants NIPS 2015
Deep learning with Elastic Averaging SGD NIPS 2015
Path-SGD: Path-Normalized Optimization in Deep Neural Networks NIPS 2015
Variance Reduced Stochastic Gradient Descent with Neighbors NIPS 2015
Preconditioned Spectral Descent for Deep Learning NIPS 2015
Stochastic Spectral Descent for Restricted Boltzmann Machines AISTATS 2015
Escaping From Saddle Points — Online Stochastic Gradient for Tensor Decomposition COLT 2015