Normalization

Additive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networks ICLR 2020 An Adaptive X-Vector Model for Text-Independent Speaker Verification Interspeech 2020 An Exponential Learning Rate Schedule for Deep Learning ICLR 2020 An Internal Covariate Shift Bounding Algorithm for Deep Neural Networks by Unitizing Layers' Outputs CVPR 2020 An Investigation Into the Stochasticity of Batch Whitening CVPR 2020 Attentive Normalization for Conditional Image Generation CVPR 2020 Batch Normalization Biases Residual Blocks Towards the Identity Function in Deep Networks NeurIPS 2020 Batch normalization provably avoids ranks collapse for randomly initialised deep networks NeurIPS 2020 Batch norm with entropic regularization turns deterministic autoencoders into generative models UAI 2020 Channel Equilibrium Networks for Learning Deep Representation ICML 2020 Controllable Orthogonalization in Training DNNs CVPR 2020 DropEdge: Towards Deep Graph Convolutional Networks on Node Classification ICLR 2020 Dynamic Instance Normalization for Arbitrary Style Transfer AAAI 2020 Evolving Normalization-Activation Layers NeurIPS 2020 Exemplar Normalization for Learning Deep Representation CVPR 2020 Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Networks CVPR 2020 Four Things Everyone Should Know to Improve Batch Normalization ICLR 2020 Improving model calibration with accuracy versus uncertainty optimization NeurIPS 2020 Instance Enhancement Batch Normalization: An Adaptive Regulator of Batch Noise AAAI 2020 Intriguing Properties of Adversarial Training at Scale ICLR 2020 Is normalization indispensable for training deep neural network? NeurIPS 2020 Local Context Normalization: Revisiting Local Normalization CVPR 2020 Monotonic Multihead Attention ICLR 2020 Network Deconvolution ICLR 2020 Neural Pose Transfer by Spatially Adaptive Instance Normalization CVPR 2020