Neural Network Optimization

VECA: A Method for Detecting Overfitting in Neural Networks (Student Abstract) AAAI 2020 What's Hidden in a Randomly Weighted Neural Network? CVPR 2020 When NAS Meets Robustness: In Search of Robust Architectures Against Adversarial Attacks CVPR 2020 Winnowing with Gradient Descent COLT 2020 Accelerating Rescaled Gradient Descent: Fast Optimization of Smooth Functions NeurIPS 2019 Adaptive Gradient Methods with Dynamic Bound of Learning Rate ICLR 2019 AdaShift: Decorrelation and Convergence of Adaptive Learning Rate Methods ICLR 2019 Aggregated Momentum: Stability Through Passive Damping ICLR 2019 A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-Off NeurIPS 2019 A Meta-Learning Approach for Custom Model Training AAAI 2019 ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs IJCAI 2019 A Sufficient Condition for Convergences of Adam and RMSProp CVPR 2019 Asymmetric Valleys: Beyond Sharp and Flat Local Minima NeurIPS 2019 Auto-Sizing the Transformer Network: Improving Speed, Efficiency, and Performance for Low-Resource Machine Translation EMNLP 2019 Balanced Sparsity for Efficient DNN Inference on GPU AAAI 2019 Bayesian Learning of Neural Network Architectures AISTATS 2019 Beyond Backprop: Online Alternating Minimization with Auxiliary Variables ICML 2019 Calibrated Stochastic Gradient Descent for Convolutional Neural Networks AAAI 2019 Capacity Control of ReLU Neural Networks by Basis-Path Norm AAAI 2019 Cascaded Projection: End-To-End Network Compression and Acceleration CVPR 2019 Centripetal SGD for Pruning Very Deep Convolutional Networks With Complicated Structure CVPR 2019 ChamNet: Towards Efficient Network Design Through Platform-Aware Model Adaptation CVPR 2019 Complex Unitary Recurrent Neural Networks Using Scaled Cayley Transform AAAI 2019 Continual and Multi-Task Architecture Search ACL 2019 Customizable Architecture Search for Semantic Segmentation CVPR 2019