Normalization

Path-BN: Towards effective batch normalization in the Path Space for ReLU networks UAI 2021 Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence NeurIPS 2021 Randomized Automatic Differentiation ICLR 2021 R-Drop: Regularized Dropout for Neural Networks NeurIPS 2021 Rebooting ACGAN: Auxiliary Classifier GANs with Stable Training NeurIPS 2021 Region-Aware Adaptive Instance Normalization for Image Harmonization CVPR 2021 Representative Batch Normalization With Feature Calibration CVPR 2021 Revisiting Batch Normalization for Improving Corruption Robustness WACV 2021 Ringing ReLUs: Harmonic Distortion Analysis of Nonlinear Feedforward Networks ICLR 2021 RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whitening CVPR 2021 SaliencyMix: A Saliency Guided Data Augmentation Strategy for Better Regularization ICLR 2021 Soft Calibration Objectives for Neural Networks NeurIPS 2021 Sparse Attention with Linear Units EMNLP 2021 Sparsity Aware Normalization for GANs AAAI 2021 Spectral Normalisation for Deep Reinforcement Learning: An Optimisation Perspective ICML 2021 Spectral Smoothing Unveils Phase Transitions in Hierarchical Variational Autoencoders ICML 2021 Stateful ODE-Nets using Basis Function Expansions NeurIPS 2021 Stochastic Whitening Batch Normalization CVPR 2021 Towards Defending against Adversarial Examples via Attack-Invariant Features ICML 2021 Towards Stable and Robust AdderNets NeurIPS 2021 Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs ICLR 2021 Why Spectral Normalization Stabilizes GANs: Analysis and Improvements NeurIPS 2021 A Batch Normalized Inference Network Keeps the KL Vanishing Away ACL 2020 ACNe: Attentive Context Normalization for Robust Permutation-Equivariant Learning CVPR 2020 Adaptive Convolutional ReLUs AAAI 2020