layer normalization

PowerNorm: Rethinking Batch Normalization in Transformers ICML 2020 Rethinking Skip Connection with Layer Normalization COLING 2020 Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention EMNLP 2019 Instance-Level Meta Normalization CVPR 2019 Learning Deep Transformer Models for Machine Translation ACL 2019 Learning Speaker Aware Offsets for Speaker Adaptation of Neural Networks Interspeech 2019 Normalization Helps Training of Quantized LSTM NeurIPS 2019 Root Mean Square Layer Normalization NeurIPS 2019 SSN: Learning Sparse Switchable Normalization via SparsestMax CVPR 2019 The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks NeurIPS 2019 Understanding and Improving Layer Normalization NeurIPS 2019 Unsupervised Stylish Image Description Generation via Domain Layer Norm AAAI 2019 Kalman Normalization: Normalizing Internal Representations Across Network Layers NeurIPS 2018 Dynamic Layer Normalization for Adaptive Neural Acoustic Modeling in Speech Recognition Interspeech 2017