neural network training

Ouroboros: On Accelerating Training of Transformer-Based Language Models NeurIPS 2019 Overcoming Multi-model Forgetting ICML 2019 Overparameterized Nonlinear Learning: Gradient Descent Takes the Shortest Path? ICML 2019 P2SGrad: Refined Gradients for Optimizing Deep Face Models CVPR 2019 Per-Tensor Fixed-Point Quantization of the Back-Propagation Algorithm ICLR 2019 Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules ICML 2019 Quasi-hyperbolic momentum and Adam for deep learning ICLR 2019 Regularizing Activation Distribution for Training Binarized Deep Networks CVPR 2019 Robust Bi-Tempered Logistic Loss Based on Bregman Divergences NeurIPS 2019 Robust Video Stabilization by Optimization in CNN Weight Space CVPR 2019 Stochastic Nonconvex Optimization with Large Minibatches ALT 2019 Superposition of many models into one NeurIPS 2019 The Unbearable Weight of Generating Artificial Errors for Grammatical Error Correction ACL 2019 Training Deep Neural Networks in Generations: A More Tolerant Teacher Educates Better Students AAAI 2019 An Empirical Evaluation of Sketched SVD and its Application to Leverage Score Ordering ACML 2018 An Optimal Control Approach to Deep Learning and Applications to Discrete-Weight Neural Networks ICML 2018 A PID Controller Approach for Stochastic Optimization of Deep Networks CVPR 2018 BOHB: Robust and Efficient Hyperparameter Optimization at Scale ICML 2018 Can We Gain More from Orthogonality Regularizations in Training Deep Networks? NeurIPS 2018 Data-driven Onboard Scheduling for an Autonomous Observation Satellite IJCAI 2018 Gradient Diversity: a Key Ingredient for Scalable Distributed Learning AISTATS 2018 Not All Samples Are Created Equal: Deep Learning with Importance Sampling ICML 2018 On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport NeurIPS 2018 PCA of high dimensional random walks with comparison to neural network training NeurIPS 2018 Post: Device Placement with Cross-Entropy Minimization and Proximal Policy Optimization NeurIPS 2018