Neural Network Optimization

Transformer-based Automatic Post-Editing Model with Joint Encoder and Multi-source Attention of Decoder ACL 2019 Turbo Autoencoder: Deep learning based channel codes for point-to-point communication channels NeurIPS 2019 Two Tiered Distributed Training Algorithm for Acoustic Modeling Interspeech 2019 Ultra-Compact NLU: Neuronal Network Binarization as Regularization Interspeech 2019 UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using BERT and SVMs SemEval 2019 Uncertainty Guided Multi-Scale Residual Learning-Using a Cycle Spinning CNN for Single Image De-Raining CVPR 2019 Understanding and Controlling Memory in Recurrent Neural Networks ICML 2019 Understanding and correcting pathologies in the training of learned optimizers ICML 2019 Understanding and Improving Layer Normalization NeurIPS 2019 Understanding the Disharmony Between Dropout and Batch Normalization by Variance Shift CVPR 2019 Understanding the Role of Momentum in Stochastic Gradient Methods NeurIPS 2019 Universal Approximation of Input-Output Maps by Temporal Convolutional Nets NeurIPS 2019 Universally Slimmable Networks and Improved Training Techniques ICCV 2019 Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach AISTATS 2019 Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Input NeurIPS 2019 Visualizing and Understanding the Effectiveness of BERT EMNLP 2019 What Part of the Neural Network Does This? Understanding LSTMs by Measuring and Dissecting Neurons EMNLP 2019 Who is Afraid of Big Bad Minima? Analysis of gradient-flow in spiked matrix-tensor models NeurIPS 2019 Wide-Coverage Neural A* Parsing for Minimalist Grammars ACL 2019 Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent NeurIPS 2019 ZO-AdaMM: Zeroth-Order Adaptive Momentum Method for Black-Box Optimization NeurIPS 2019 A Bridging Framework for Model Optimization and Deep Propagation NeurIPS 2018 Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent COLT 2018 Accelerated Stochastic Mirror Descent: From Continuous-time Dynamics to Discrete-time Algorithms AISTATS 2018 Accelerated Stochastic Power Iteration AISTATS 2018