Neural Network Optimization

Fast and Practical Neural Architecture Search ICCV 2019 Fast Convergence of Natural Gradient Descent for Over-Parameterized Neural Networks NeurIPS 2019 Faster Distributed Deep Net Training: Computation and Communication Decoupled Stochastic Gradient Descent IJCAI 2019 Faster First-Order Methods for Stochastic Non-Convex Optimization on Riemannian Manifolds AISTATS 2019 FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search CVPR 2019 Fine-grained Optimization of Deep Neural Networks NeurIPS 2019 Fine-tune BERT with Sparse Self-Attention Mechanism EMNLP 2019 First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise NeurIPS 2019 Fisher Information and Natural Gradient Learning in Random Deep Networks AISTATS 2019 Fixing Implicit Derivatives: Trust-Region Based Learning of Continuous Energy Functions NeurIPS 2019 Fixup Initialization: Residual Learning Without Normalization ICLR 2019 Forecasting Firm Material Events from 8-K Reports EMNLP 2019 Forget a Bit to Learn Better: Soft Forgetting for CTC-Based Automatic Speech Recognition Interspeech 2019 Frame-Consistent Recurrent Video Deraining With Dual-Level Flow CVPR 2019 Gate Decorator: Global Filter Pruning Method for Accelerating Deep Convolutional Neural Networks NeurIPS 2019 Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks NeurIPS 2019 Generalization in Reinforcement Learning with Selective Noise Injection and Information Bottleneck NeurIPS 2019 GIRNet: Interleaved Multi-Task Recurrent State Sequence Models AAAI 2019 GO Gradient for Expectation-Based Objectives ICLR 2019 Gradient Descent Finds Global Minima of Deep Neural Networks ICML 2019 Gradient Descent Provably Optimizes Over-parameterized Neural Networks ICLR 2019 Gradient Dynamics of Shallow Univariate ReLU Networks NeurIPS 2019 Graph Policy Gradients for Large Scale Robot Control CoRL 2019 G-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space ICLR 2019 Guided Dropout AAAI 2019