Neural Network Optimization

Rethinking Performance Estimation in Neural Architecture Search CVPR 2020 Revisiting Parameter Sharing for Automatic Neural Channel Number Search NeurIPS 2020 Robust Recovery via Implicit Bias of Discrepant Learning Rates for Double Over-parameterization NeurIPS 2020 Search Tree Pruning for Progressive Neural Architecture Search (Student Abstract) AAAI 2020 SelectScale: Mining More Patterns from Images via Selective and Soft Dropout IJCAI 2020 Self-Orthogonality Module: A Network Architecture Plug-in for Learning Orthogonal Filters WACV 2020 SGAS: Sequential Greedy Architecture Search CVPR 2020 Shallow-to-Deep Training for Neural Machine Translation EMNLP 2020 Sideways: Depth-Parallel Training of Video Models CVPR 2020 Stochastic Gauss-Newton Algorithms for Nonconvex Compositional Optimization ICML 2020 Stochastic Loss Function AAAI 2020 Streaming Batch Gradient Tracking for Neural Network Training (Student Abstract) AAAI 2020 Strip Pooling: Rethinking Spatial Pooling for Scene Parsing CVPR 2020 The asymptotic spectrum of the Hessian of DNN throughout training ICLR 2020 The HSIC Bottleneck: Deep Learning without Back-Propagation AAAI 2020 The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent ICML 2020 The Surprising Simplicity of the Early-Time Learning Dynamics of Neural Networks NeurIPS 2020 Towards Unified INT8 Training for Convolutional Neural Network CVPR 2020 Training Binary Neural Networks using the Bayesian Learning Rule ICML 2020 Ultrafast Photorealistic Style Transfer via Neural Architecture Search AAAI 2020 UNAS: Differentiable Architecture Search Meets Reinforcement Learning CVPR 2020 Understanding and Exploring the Network with Stochastic Architectures NeurIPS 2020 Understanding the Difficulty of Training Transformers EMNLP 2020 Understanding the Disharmony between Weight Normalization Family and Weight Decay AAAI 2020 Understanding the Impact of Model Incoherence on Convergence of Incremental SGD with Random Reshuffle ICML 2020