Neural Network Optimization

DIANet: Dense-and-Implicit Attention Network AAAI 2020 DropNet: Reducing Neural Network Complexity via Iterative Pruning ICML 2020 DSNAS: Direct Neural Architecture Search Without Parameter Retraining CVPR 2020 Dynamically Adjusting Transformer Batch Size by Monitoring Gradient Direction Change ACL 2020 Dynamical System Inspired Adaptive Time Stepping Controller for Residual Network Families AAAI 2020 Dynamic Data Selection for Curriculum Learning via Ability Estimation EMNLP 2020 Dynamic Hierarchical Mimicking Towards Consistent Optimization Objectives CVPR 2020 Dynamics of Deep Neural Networks and Neural Tangent Hierarchy ICML 2020 EcoNAS: Finding Proxies for Economical Neural Architecture Search CVPR 2020 Efficient Residual Dense Block Search for Image Super-Resolution AAAI 2020 Eigenvalue Normalized Recurrent Neural Networks for Short Term Memory AAAI 2020 Evolutionary Algorithm Enhanced Neural Architecture Search for Text-Independent Speaker Verification Interspeech 2020 Fastened CROWN: Tightened Neural Network Robustness Certificates AAAI 2020 FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions CVPR 2020 F-BRS: Rethinking Backpropagating Refinement for Interactive Segmentation CVPR 2020 Filter Grafting for Deep Neural Networks CVPR 2020 Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Networks CVPR 2020 Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent ICML 2020 Fractional Skipping: Towards Finer-Grained Dynamic CNN Inference AAAI 2020 Fractional Underdamped Langevin Dynamics: Retargeting SGD with Momentum under Heavy-Tailed Gradient Noise ICML 2020 GAIT-prop: A biologically plausible learning rule derived from backpropagation of error NeurIPS 2020 Generalization bound of globally optimal non-convex neural network training: Transportation map estimation by infinite dimensional Langevin dynamics NeurIPS 2020 Generalization Error Bounds of Gradient Descent for Learning Over-Parameterized Deep ReLU Networks AAAI 2020 Going Deep: Graph Convolutional Ladder-Shape Networks AAAI 2020 Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection ICML 2020