Neural Network Optimization

Almost Surely Stable Deep Dynamics NeurIPS 2020 A Lyapunov analysis for accelerated gradient methods: from deterministic to stochastic case AISTATS 2020 A mathematical model for automatic differentiation in machine learning NeurIPS 2020 Analytic Characterization of the Hessian in Shallow ReLU Models: A Tale of Symmetry NeurIPS 2020 Anchor Box Optimization for Object Detection WACV 2020 An Effective Perturbation Based Semi-Supervised Learning Method for Sound Event Detection Interspeech 2020 An Empirical Investigation of Beam-Aware Training in Supertagging EMNLP 2020 A "Network Pruning Network'' Approach to Deep Model Compression WACV 2020 A new regret analysis for Adam-type algorithms ICML 2020 A New Training Pipeline for an Improved Neural Transducer Interspeech 2020 An Improved Analysis of Stochastic Gradient Descent with Momentum NeurIPS 2020 An Internal Covariate Shift Bounding Algorithm for Deep Neural Networks by Unitizing Layers' Outputs CVPR 2020 A shooting formulation of deep learning NeurIPS 2020 A simpler approach to accelerated optimization: iterative averaging meets optimism ICML 2020 A Study on Encodings for Neural Architecture Search NeurIPS 2020 Asymptotic Analysis via Stochastic Differential Equations of Gradient Descent Algorithms in Statistical and Computational Paradigms JMLR 2020 A Theoretical Framework for Target Propagation NeurIPS 2020 AtLoc: Attention Guided Camera Localization AAAI 2020 At Stability's Edge: How to Adjust Hyperparameters to Preserve Minima Selection in Asynchronous Training of Neural Networks? ICLR 2020 A Two-Step Approach for Automatic OCR Post-Correction COLING 2020 A Unified Framework of Online Learning Algorithms for Training Recurrent Neural Networks JMLR 2020 A Unified Theory of Decentralized SGD with Changing Topology and Local Updates ICML 2020 Automatic Differentiation of Some First-Order Methods in Parametric Optimization AISTATS 2020 AutoShrink: A Topology-Aware NAS for Discovering Efficient Neural Architecture AAAI 2020 AutoTrack: Towards High-Performance Visual Tracking for UAV With Automatic Spatio-Temporal Regularization CVPR 2020