Neural Network Optimization

Accelerating Stratified Sampling SGD by Reconstructing Strata IJCAI 2020 Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping NeurIPS 2020 Acceleration through spectral density estimation ICML 2020 A Closer Look at Accuracy vs. Robustness NeurIPS 2020 A Constraint-Based Approach to Learning and Explanation AAAI 2020 A Constructive Prediction of the Generalization Error Across Scales ICLR 2020 Acoustic-to-Articulatory Inversion with Deep Autoregressive Articulatory-WaveNet Interspeech 2020 AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients NeurIPS 2020 AdaGrad stepsizes: Sharp convergence over nonconvex landscapes JMLR 2020 Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODE ICML 2020 Adaptive Convolutional ReLUs AAAI 2020 Adaptive Gradient Descent without Descent ICML 2020 Adaptive Gradient Quantization for Data-Parallel SGD NeurIPS 2020 Adaptive Interaction Modeling via Graph Operations Search CVPR 2020 AdaScale SGD: A User-Friendly Algorithm for Distributed Training ICML 2020 AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning NeurIPS 2020 AdaTune: Adaptive Tensor Program Compilation Made Efficient NeurIPS 2020 Adversarial Risk Bounds through Sparsity based Compression AISTATS 2020 A Finite-Time Analysis of Two Time-Scale Actor-Critic Methods NeurIPS 2020 A Generalized Neural Tangent Kernel Analysis for Two-layer Neural Networks NeurIPS 2020 A General System of Differential Equations to Model First-Order Adaptive Algorithms JMLR 2020 Agnostic Learning of a Single Neuron with Gradient Descent NeurIPS 2020 A Joint Model for Document Segmentation and Segment Labeling ACL 2020 Alleviation of Gradient Exploding in GANs: Fake Can Be Real CVPR 2020 All in One Bad Weather Removal Using Architectural Search CVPR 2020