Neural Network Optimization

Accumulated Gradient Normalization ACML 2017 Adaptive Accelerated Gradient Converging Method under H\"{o}lderian Error Bound Condition NeurIPS 2017 Adaptive Learning Rate via Covariance Matrix Based Preconditioning for Deep Neural Networks IJCAI 2017 Adaptive SVRG Methods under Error Bound Conditions with Unknown Growth Parameter NeurIPS 2017 A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction IJCAI 2017 All You Need Is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks With Orthonormality and Modulation CVPR 2017 A Modular Analysis of Adaptive (Non-)Convex Optimization: Optimism, Composite Objectives, and Variational Bounds ALT 2017 An Analytical Formula of Population Gradient for two-layered ReLU network and its Applications in Convergence and Critical Point Analysis ICML 2017 An Efficient Phone N-Gram Forward-Backward Computation Using Dense Matrix Multiplication Interspeech 2017 A Nested Attention Neural Hybrid Model for Grammatical Error Correction ACL 2017 A Neural Parametric Singing Synthesizer Interspeech 2017 Annealed f-Smoothing as a Mechanism to Speed up Neural Network Training Interspeech 2017 Approximate Large-scale Multiple Kernel k-means Using Deep Neural Network IJCAI 2017 Approximate Newton Methods and Their Local Convergence ICML 2017 ASAGA: Asynchronous Parallel SAGA AISTATS 2017 A Sensitivity Analysis of (and Practitioners’ Guide to) Convolutional Neural Networks for Sentence Classification IJCNLP 2017 A Sequence Labeling Convolutional Network and Its Application to Handwritten String Recognition IJCAI 2017 Backstitch: Counteracting Finite-Sample Bias via Negative Steps Interspeech 2017 Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models NeurIPS 2017 Boosting Neural Machine Translation IJCNLP 2017 Convergence Analysis of Proximal Gradient with Momentum for Nonconvex Optimization ICML 2017 Convergence Analysis of Two-layer Neural Networks with ReLU Activation NeurIPS 2017 Decoupled Neural Interfaces using Synthetic Gradients ICML 2017 Deep Activation Mixture Model for Speech Recognition Interspeech 2017 Deep Neural Machine Translation with Linear Associative Unit ACL 2017