← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

Progressive Differentiable Architecture Search: Bridging the Depth Gap Between Search and Evaluation ICCV 2019
Adaptive Parameterization for Neural Dialogue Generation IJCNLP 2019
Understanding and Improving Layer Normalization NIPS 2019
Pyramidal Recurrent Unit for Language Modeling EMNLP 2018
Gradient Descent Learns One-hidden-layer CNN: Don’t be Afraid of Spurious Local Minima ICML 2018
Gradient descent with identity initialization efficiently learns positive definite linear transformations by deep residual networks ICML 2018
Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks ICML 2018
Learning Longer-term Dependencies in RNNs with Auxiliary Losses ICML 2018
Optimization Landscape and Expressivity of Deep CNNs ICML 2018
Decoupled Parallel Backpropagation with Convergence Guarantee ICML 2018
Transfer Learning with Neural AutoML NIPS 2018
Dissecting Adam: The Sign, Magnitude and Variance of Stochastic Gradients ICML 2018
On Markov Chain Gradient Descent NIPS 2018
Direct Runge-Kutta Discretization Achieves Acceleration NIPS 2018
How SGD Selects the Global Minima in Over-parameterized Learning: A Dynamical Stability Perspective NIPS 2018
Breaking the Span Assumption Yields Fast Finite-Sum Minimization NIPS 2018
Sparsified SGD with Memory NIPS 2018
Variance-Reduced Stochastic Gradient Descent on Streaming Data NIPS 2018
How to Start Training: The Effect of Initialization and Architecture NIPS 2018
Dilated Convolutional Network with Iterative Optimization for Continuous Sign Language Recognition IJCAI 2018
Generating Reasonable and Diversified Story Ending Using Sequence to Sequence Model with Adversarial Training COLING 2018
PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning ICML 2018
Linear Stochastic Approximation: How Far Does Constant Step-Size and Iterate Averaging Go? AISTATS 2018
SSN MLRG1 at SemEval-2018 Task 3: Irony Detection in English Tweets Using MultiLayer Perceptron SEMEVAL 2018
Dual Skipping Networks CVPR 2018