Normalization

Removing the Feature Correlation Effect of Multiplicative Noise NeurIPS 2018 Spectral Normalization for Generative Adversarial Networks ICLR 2018 Surprising properties of dropout in deep networks JMLR 2018 Towards Faster Training of Global Covariance Pooling Networks by Iterative Matrix Square Root Normalization CVPR 2018 Understanding Batch Normalization NeurIPS 2018 Understanding Weight Normalized Deep Neural Networks with Rectified Linear Units NeurIPS 2018 Wavelet Pooling for Convolutional Neural Networks ICLR 2018 Annealed f-Smoothing as a Mechanism to Speed up Neural Network Training Interspeech 2017 Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models NeurIPS 2017 ConvNets with Smooth Adaptive Activation Functions for Regression AISTATS 2017 Deep Hyperspherical Learning NeurIPS 2017 Dynamic Layer Normalization for Adaptive Neural Acoustic Modeling in Speech Recognition Interspeech 2017 Improved Texture Networks: Maximizing Quality and Diversity in Feed-Forward Stylization and Texture Synthesis CVPR 2017 Improving Training of Deep Neural Networks via Singular Value Bounding CVPR 2017 Learning Deep Architectures via Generalized Whitened Neural Networks ICML 2017 On Calibration of Modern Neural Networks ICML 2017 Regularizing Deep Neural Networks by Noise: Its Interpretation and Optimization NeurIPS 2017 Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice NeurIPS 2017 Revisit Fuzzy Neural Network: Demystifying Batch Normalization and ReLU with Generalized Hamming Network NeurIPS 2017 Riemannian approach to batch normalization NeurIPS 2017 Self-Normalizing Neural Networks NeurIPS 2017 Surprising properties of dropout in deep networks COLT 2017 The Shattered Gradients Problem: If resnets are the answer, then what is the question? ICML 2017 Train longer, generalize better: closing the generalization gap in large batch training of neural networks NeurIPS 2017 Variational Dropout Sparsifies Deep Neural Networks ICML 2017