← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

Stochastic Gradient Descent Learns State Equations with Nonlinear Activations COLT 2019
Neural Architecture Search: A Survey JMLR 2019
Control Regularization for Reduced Variance Reinforcement Learning ICML 2019
Transductive Auxiliary Task Self-Training for Neural Multi-Task Models EMNLP 2019
Hierarchical Pointer Net Parsing EMNLP 2019
Neuron birth-death dynamics accelerates gradient descent and converges asymptotically ICML 2019
A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks ICML 2019
Differentiable Dynamic Normalization for Learning Deep Representation ICML 2019
Overcoming Multi-model Forgetting ICML 2019
Revealing the Dark Secrets of BERT EMNLP 2019
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition EMNLP 2019
Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention EMNLP 2019
Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search ICML 2019
Lexicographic and Depth-Sensitive Margins in Homogeneous and Non-Homogeneous Deep Models ICML 2019
Learning Transformation Synchronization CVPR 2019
Nostalgic Adam: Weighting More of the Past Gradients When Designing the Adaptive Learning Rate IJCAI 2019
Capacity Control of ReLU Neural Networks by Basis-Path Norm AAAI 2019
HyperAdam: A Learnable Task-Adaptive Adam for Network Training AAAI 2019
Explicitly Imposing Constraints in Deep Networks via Conditional Gradients Gives Improved Generalization and Faster Convergence AAAI 2019
EA-CG: An Approximate Second-Order Method for Training Fully-Connected Neural Networks AAAI 2019
A Lightweight Recurrent Network for Sequence Modeling ACL 2019
Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Group ICML 2019
Cascade RPN: Delving into High-Quality Region Proposal Network with Adaptive Convolution NIPS 2019
Traditional and Heavy Tailed Self Regularization in Neural Network Models ICML 2019
Lifted Proximal Operator Machines AAAI 2019