Normalization

AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights ICLR 2021 A Deep Conditioning Treatment of Neural Networks ALT 2021 Adversarially Adaptive Normalization for Single Domain Generalization CVPR 2021 ALADIN: All Layer Adaptive Instance Normalization for Fine-Grained Style Similarity ICCV 2021 Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections ICML 2021 A Trace-restricted Kronecker-Factored Approximation to Natural Gradient AAAI 2021 AugMax: Adversarial Composition of Random Augmentations for Robust Training NeurIPS 2021 Batch Normalization Increases Adversarial Vulnerability and Decreases Adversarial Transferability: A Non-Robust Feature Perspective ICCV 2021 Batch Normalization Orthogonalizes Representations in Deep Random Networks NeurIPS 2021 Better Training using Weight-Constrained Stochastic Dynamics ICML 2021 Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning NeurIPS 2021 Bit-Mixer: Mixed-Precision Networks With Runtime Bit-Width Selection ICCV 2021 Calibration of Neural Networks using Splines ICLR 2021 Characterizing signal propagation to close the performance gap in unnormalized ResNets ICLR 2021 Class Normalization for (Continual)? Generalized Zero-Shot Learning ICLR 2021 Constrained Weight Optimization for Learning Without Activation Normalization WACV 2021 Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training NeurIPS 2021 Cross-Iteration Batch Normalization CVPR 2021 CrossNorm and SelfNorm for Generalization Under Distribution Shifts ICCV 2021 Data-Efficient Alignment of Multimodal Sequences by Aligning Gradient Updates and Internal Feature Distributions WACV 2021 Deconstructing the Regularization of BatchNorm ICLR 2021 Delving into Variance Transmission and Normalization: Shift of Average Gradient Makes the Network Collapse AAAI 2021 Dropout: Explicit Forms and Capacity Control ICML 2021 Dropout Regularization for Self-Supervised Learning of Transformer Encoder Speech Representation Interspeech 2021 Dynamic Normalization and Relay for Video Action Recognition NeurIPS 2021