Normalization

New Interpretations of Normalization Methods in Deep Learning AAAI 2020 On Convergence and Generalization of Dropout Training NeurIPS 2020 On Layer Normalization in the Transformer Architecture ICML 2020 On the Sentence Embeddings from Pre-trained Language Models EMNLP 2020 Optimization Theory for ReLU Neural Networks Trained with Normalization Layers ICML 2020 PairNorm: Tackling Oversmoothing in GNNs ICLR 2020 Passport-aware Normalization for Deep Model Protection NeurIPS 2020 Position-Aware Recalibration Module: Learning From Feature Semantics and Feature Position IJCAI 2020 PowerNorm: Rethinking Batch Normalization in Transformers ICML 2020 Query-Key Normalization for Transformers EMNLP 2020 Recognizing Instagram Filtered Images with Feature De-Stylization AAAI 2020 Region Normalization for Image Inpainting AAAI 2020 Regularizing activations in neural networks via distribution matching with the Wasserstein metric ICLR 2020 Rethinking Depthwise Separable Convolutions: How Intra-Kernel Correlations Lead to Improved MobileNets CVPR 2020 Rethinking Skip Connection with Layer Normalization COLING 2020 SEAN: Image Synthesis With Semantic Region-Adaptive Normalization CVPR 2020 Smoothed Geometry for Robust Attribution NeurIPS 2020 Stable Rank Normalization for Improved Generalization in Neural Networks and GANs ICLR 2020 Stochastic Batch Augmentation with An Effective Distilled Dynamic Soft Label Regularizer IJCAI 2020 Stochastic Normalization NeurIPS 2020 TaskNorm: Rethinking Batch Normalization for Meta-Learning ICML 2020 The Break-Even Point on Optimization Trajectories of Deep Neural Networks ICLR 2020 The Implicit and Explicit Regularization Effects of Dropout ICML 2020 Towards Achieving Adversarial Robustness by Enforcing Feature Consistency Across Bit Planes CVPR 2020 Towards data-driven stroke rehabilitation via wearable sensors and deep learning MLHC 2020