← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

Gradient Dynamics of Shallow Univariate ReLU Networks NIPS 2019
MetaInit: Initializing learning by learning to initialize NIPS 2019
Deep Cascade Multi-Task Learning for Slot Filling in Online Shopping Assistant AAAI 2019
Meta-Curvature NIPS 2019
Deep Reinforcement Learning via Past-Success Directed Exploration AAAI 2019
Asynchronous Proximal Stochastic Gradient Algorithm for Composition Optimization Problems AAAI 2019
Hierarchical Context Enabled Recurrent Neural Network for Recommendation AAAI 2019
Numerical Optimization to AI, and Back AAAI 2019
ANODEV2: A Coupled Neural ODE Framework NIPS 2019
Learning Deep Transformer Models for Machine Translation ACL 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned ACL 2019
Limitations of the empirical Fisher approximation for natural gradient descent NIPS 2019
On the Ineffectiveness of Variance Reduced Optimization for Deep Learning NIPS 2019
Towards Understanding the Importance of Shortcut Connections in Residual Networks NIPS 2019
On the Realization of Compositionality in Neural Networks ACL 2019
Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting NIPS 2019
RSN: Randomized Subspace Newton NIPS 2019
Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion INTERSPEECH 2019
Analysis of Pronunciation Learning in End-to-End Speech Synthesis INTERSPEECH 2019
How to Initialize your Network? Robust Initialization for WeightNorm & ResNets NIPS 2019
LCA: Loss Change Allocation for Neural Network Training NIPS 2019
Memory Efficient Adaptive Optimization NIPS 2019
Deep Equilibrium Models NIPS 2019
Catastrophic Forgetting Meets Negative Transfer: Batch Spectral Shrinkage for Safe Transfer Learning NIPS 2019
Limitations of Lazy Training of Two-layers Neural Network NIPS 2019