neural network optimization

Shallow-Deep Networks: Understanding and Mitigating Network Overthinking ICML 2019 ShrinkML: End-to-End ASR Model Compression Using Reinforcement Learning Interspeech 2019 Simultaneously Optimizing Weight and Quantizer of Ternary Neural Network Using Truncated Gaussian Approximation CVPR 2019 Spurious Valleys in One-hidden-layer Neural Network Optimization Landscapes JMLR 2019 Super Sparse Convolutional Neural Networks AAAI 2019 Surfing: Iterative Optimization Over Incrementally Trained Deep Networks NeurIPS 2019 The Goldilocks Zone: Towards Better Understanding of Neural Network Loss Landscapes AAAI 2019 The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks NeurIPS 2019 Theoretical Investigation of Generalization Bound for Residual Networks IJCAI 2019 Time/Accuracy Tradeoffs for Learning a ReLU with respect to Gaussian Marginals NeurIPS 2019 Two Tiered Distributed Training Algorithm for Acoustic Modeling Interspeech 2019 Two-Timescale Networks for Nonlinear Value Function Approximation ICLR 2019 Understanding and correcting pathologies in the training of learned optimizers ICML 2019 Universal Approximation Property and Equivalence of Stochastic Computing-Based Neural Networks and Binary Neural Networks AAAI 2019 Universally Slimmable Networks and Improved Training Techniques ICCV 2019 Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach AISTATS 2019 Wasserstein GAN With Quadratic Transport Cost ICCV 2019 Whether to Pretrain DNN or not?: An Empirical Analysis for Voice Conversion Interspeech 2019 Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model NeurIPS 2019 Accelerating Natural Gradient with Higher-Order Invariance ICML 2018 Adding One Neuron Can Eliminate All Bad Local Minima NeurIPS 2018 A Linear Speedup Analysis of Distributed Deep Learning with Sparse and Quantized Communication NeurIPS 2018 Are ResNets Provably Better than Linear Predictors? NeurIPS 2018 Backpropagating through Structured Argmax using a SPIGOT ACL 2018 Beyond Trade-Off: Accelerate FCN-Based Face Detector With Higher Accuracy CVPR 2018