Optimization

A Bridging Framework for Model Optimization and Deep Propagation NeurIPS 2018 Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation EMNLP 2018 Accelerating Natural Gradient with Higher-Order Invariance ICML 2018 Adaptive Methods for Nonconvex Optimization NeurIPS 2018 Adaptive Negative Curvature Descent with Applications in Non-convex Optimization NeurIPS 2018 Adaptive Quantization of Neural Networks ICLR 2018 ADMM and Accelerated ADMM as Continuous Dynamical Systems ICML 2018 A Hierarchical Model for Device Placement ICLR 2018 A Linear Speedup Analysis of Distributed Deep Learning with Sparse and Quantized Communication NeurIPS 2018 A PID Controller Approach for Stochastic Optimization of Deep Networks CVPR 2018 Approximating Real-Time Recurrent Learning with Random Kronecker Factors NeurIPS 2018 A Two-Step Computation of the Exact GAN Wasserstein Distance ICML 2018 Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari IJCAI 2018 Boosting Adversarial Attacks With Momentum CVPR 2018 BPGrad: Towards Global Optimality in Deep Learning via Branch and Pruning CVPR 2018 Breaking the Beam Search Curse: A Study of (Re-)Scoring Methods and Stopping Criteria for Neural Machine Translation EMNLP 2018 Byzantine Stochastic Gradient Descent NeurIPS 2018 Conditional-Computation-Based Recurrent Neural Networks for Computationally Efficient Acoustic Modelling Interspeech 2018 Data-Dependent Stability of Stochastic Gradient Descent ICML 2018 Decorrelated Batch Normalization CVPR 2018 DiCE: The Infinitely Differentiable Monte Carlo Estimator ICML 2018 Don't Decay the Learning Rate, Increase the Batch Size ICLR 2018 DRACO: Byzantine-resilient Distributed Training via Redundant Gradients ICML 2018 Dropping Symmetry for Fast Symmetric Nonnegative Matrix Factorization NeurIPS 2018 Efficient Convex Completion of Coupled Tensors using Coupled Nuclear Norms NeurIPS 2018