Neural Network Optimization

Learning Deep Transformer Models for Machine Translation ACL 2019 Learning in the Machine: Random Backpropagation and the Deep Learning Channel (Extended Abstract) IJCAI 2019 Learning One-hidden-layer Neural Networks under General Input Distributions AISTATS 2019 Learning One-hidden-layer ReLU Networks via Gradient Descent AISTATS 2019 Learning to Calibrate Straight Lines for Fisheye Image Rectification CVPR 2019 Learning Transformation Synchronization CVPR 2019 Learning Two-layer Neural Networks with Symmetric Inputs ICLR 2019 Learning Two Layer Rectified Neural Networks in Polynomial Time COLT 2019 Lexicographic and Depth-Sensitive Margins in Homogeneous and Non-Homogeneous Deep Models ICML 2019 Lifted Proximal Operator Machines AAAI 2019 Limitations of Lazy Training of Two-layers Neural Network NeurIPS 2019 Limitations of the empirical Fisher approximation for natural gradient descent NeurIPS 2019 Lipschitz Adaptivity with Multiple Learning Rates in Online Learning COLT 2019 Loaded DiCE: Trading off Bias and Variance in Any-Order Score Function Gradient Estimators for Reinforcement Learning NeurIPS 2019 Local Saddle Point Optimization: A Curvature Exploitation Approach AISTATS 2019 Local to Global Learning: Gradually Adding Classes for Training Deep Neural Networks CVPR 2019 Long Short-Term Memory with Dynamic Skip Connections AAAI 2019 Lookahead Optimizer: k steps forward, 1 step back NeurIPS 2019 Look Back and Predict Forward in Image Captioning CVPR 2019 Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning EMNLP 2019 LSTM Based Similarity Measurement with Spectral Clustering for Speaker Diarization Interspeech 2019 Machine Vision Guided 3D Medical Image Compression for Efficient Transmission and Accurate Segmentation in the Clouds CVPR 2019 Making Asynchronous Stochastic Gradient Descent Work for Transformers EMNLP 2019 Measuring and regularizing networks in function space ICLR 2019 Measuring the Effects of Data Parallelism on Neural Network Training JMLR 2019