Neural Network Optimization

SADAGRAD: Strongly Adaptive Stochastic Gradient Methods ICML 2018 Scale-Recurrent Network for Deep Image Deblurring CVPR 2018 Semi-tied Units for Efficient Gating in LSTM and Highway Networks Interspeech 2018 Sensitivity and Generalization in Neural Networks: an Empirical Study ICLR 2018 SGD Learns Over-parameterized Networks that Provably Generalize on Linearly Separable Data ICLR 2018 ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices CVPR 2018 signSGD: Compressed Optimisation for Non-Convex Problems ICML 2018 Sigsoftmax: Reanalysis of the Softmax Bottleneck NeurIPS 2018 Simple Recurrent Units for Highly Parallelizable Recurrence EMNLP 2018 Skip Connections Eliminate Singularities ICLR 2018 Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks ICLR 2018 SLAYER: Spike Layer Error Reassignment in Time NeurIPS 2018 Sparsified SGD with Memory NeurIPS 2018 Speech Intelligibility Enhancement Based on a Non-causal Wavenet-like Model Interspeech 2018 SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path-Integrated Differential Estimator NeurIPS 2018 SSN MLRG1 at SemEval-2018 Task 3: Irony Detection in English Tweets Using MultiLayer Perceptron SemEval 2018 Stabilizing Gradients for Deep Neural Networks via Efficient SVD Parameterization ICML 2018 State Gradients for RNN Memory Analysis Interspeech 2018 Step Size Matters in Deep Learning NeurIPS 2018 Stochastic Cubic Regularization for Fast Nonconvex Optimization NeurIPS 2018 Stochastic Second-Order Method for Large-Scale Nonconvex Sparse Learning Models IJCAI 2018 Stochastic Shake-Shake Regularization for Affective Learning from Speech Interspeech 2018 Stochastic Variance-Reduced Cubic Regularized Newton Methods ICML 2018 Stronger Generalization Bounds for Deep Nets via a Compression Approach ICML 2018 The Context-Dependent Additive Recurrent Neural Net NAACL 2018