Neural Network Optimization

Projection Convolutional Neural Networks for 1-bit CNNs via Discrete Back Propagation AAAI 2019 Projection-Free Bandit Convex Optimization AISTATS 2019 Propagation Mechanism for Deep and Wide Neural Networks CVPR 2019 Push-pull Feedback Implements Hierarchical Information Retrieval Efficiently NeurIPS 2019 Putting An End to End-to-End: Gradient-Isolated Learning of Representations NeurIPS 2019 Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification and Local Computations NeurIPS 2019 Quantization Networks CVPR 2019 Random Shuffling Beats SGD after Finite Epochs ICML 2019 RecurJac: An Efficient Recursive Algorithm for Bounding Jacobian Matrix of Neural Networks and Its Applications AAAI 2019 Recurrent Neural Networks With Intra-Frame Iterations for Video Deblurring CVPR 2019 Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel NeurIPS 2019 Relaxed Parameter Sharing: Effectively Modeling Time-Varying Relationships in Clinical Time-Series MLHC 2019 RENAS: Reinforced Evolutionary Neural Architecture Search CVPR 2019 RePr: Improved Training of Convolutional Filters CVPR 2019 ResNet and Batch-normalization Improve Data Separability ACML 2019 Revealing the Dark Secrets of BERT EMNLP 2019 Revisit Batch Normalization: New Understanding and Refinement via Composition Optimization AISTATS 2019 RNN Architecture Learning with Sparse Regularization EMNLP 2019 Robust descent using smoothed multiplicative noise AISTATS 2019 Robust Video Stabilization by Optimization in CNN Weight Space CVPR 2019 RSN: Randomized Subspace Newton NeurIPS 2019 SAGA with Arbitrary Sampling ICML 2019 ScratchDet: Training Single-Shot Object Detectors From Scratch CVPR 2019 Searching for a Robust Neural Architecture in Four GPU Hours CVPR 2019 Self-Attention Transducers for End-to-End Speech Recognition Interspeech 2019