Normalization

Early Stopping in Deep Networks: Double Descent and How to Eliminate it ICLR 2021 Exploiting Spiking Dynamics with Spatial-temporal Feature Normalization in Graph Learning IJCAI 2021 Exponential Moving Average Normalization for Self-Supervised and Semi-Supervised Learning CVPR 2021 Fast Certified Robust Training with Short Warmup NeurIPS 2021 Gradient Normalization for Generative Adversarial Networks ICCV 2021 GraphNorm: A Principled Approach to Accelerating Graph Neural Network Training ICML 2021 Group Whitening: Balancing Learning Efficiency and Representational Capacity CVPR 2021 High-Performance Large-Scale Image Recognition Without Normalization ICML 2021 Improving Generalization of Batch Whitening by Convolutional Unit Optimization ICCV 2021 IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization AAAI 2021 Learning Semantic Person Image Generation by Region-Adaptive Normalization CVPR 2021 Learning to live with Dale's principle: ANNs with separate excitatory and inhibitory units ICLR 2021 Lipschitz normalization for self-attention layers with application to graph neural networks ICML 2021 Machine Unlearning via Algorithmic Stability COLT 2021 Metadata Normalization CVPR 2021 MetaNorm: Learning to Normalize Few-Shot Batches Across Domains ICLR 2021 Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generation ICML 2021 Neighborhood Normalization for Robust Geometric Feature Learning CVPR 2021 Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networks ICLR 2021 Normalization Driven Zero-Shot Multi-Speaker Speech Synthesis Interspeech 2021 On Biasing Transformer Attention Towards Monotonicity NAACL 2021 On Feature Normalization and Data Augmentation CVPR 2021 On Lipschitz Regularization of Convolutional Layers using Toeplitz Matrix Theory AAAI 2021 On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay NeurIPS 2021 Partial transfusion: on the expressive influence of trainable batch norm parameters for transfer learning MIDL 2021