Neural Network Optimization

A Mean Field Theory of Batch Normalization ICLR 2019 Analysis of Pronunciation Learning in End-to-End Speech Synthesis Interspeech 2019 Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned ACL 2019 An Empirical Investigation of Global and Local Normalization for Recurrent Neural Sequence Models Using a Continuous Relaxation to Beam Search NAACL 2019 An Empirical study of Binary Neural Networks' Optimisation ICLR 2019 An Empirical Study of Example Forgetting during Deep Neural Network Learning ICLR 2019 An Improved Analysis of Training Over-parameterized Deep Neural Networks NeurIPS 2019 An Input-aware Factorization Machine for Sparse Prediction IJCAI 2019 An Investigation into Neural Net Optimization via Hessian Eigenvalue Density ICML 2019 ANODEV2: A Coupled Neural ODE Framework NeurIPS 2019 Anytime Online-to-Batch, Optimism and Acceleration ICML 2019 A Quantitative Analysis of the Effect of Batch Normalization on Gradient Descent ICML 2019 Are deep ResNets provably better than linear predictors? NeurIPS 2019 A Sufficient Condition for Convergences of Adam and RMSProp CVPR 2019 Asynchronous Proximal Stochastic Gradient Algorithm for Composition Optimization Problems AAAI 2019 A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks ICML 2019 Attending to Future Tokens for Bidirectional Sequence Generation EMNLP 2019 Attention-Enhanced Connectionist Temporal Classification for Discrete Speech Emotion Recognition Interspeech 2019 Attentive Single-Tasking of Multiple Tasks CVPR 2019 Augmented Neural ODEs NeurIPS 2019 A Universally Optimal Multistage Accelerated Stochastic Gradient Method NeurIPS 2019 AutoAssist: A Framework to Accelerate Training of Deep Neural Networks NeurIPS 2019 AutoAugment: Learning Augmentation Strategies From Data CVPR 2019 AutoDispNet: Improving Disparity Estimation With AutoML ICCV 2019 Auto-FPN: Automatic Network Architecture Adaptation for Object Detection Beyond Classification ICCV 2019