conftrace_

layer normalization

65 papers

Explore in graph

Also known as

LN LAYERNORM

Co-occurring keywords

batch normalization (222) neural network optimization (1293) neural network (6616) group normalization (13) transformer architecture (1560) deep neural network (1803) attention mechanism (4001) residual connection (55) transformer model (1996) model optimization (75)

Papers

Lipschitz Constrained Parameter Initialization for Deep Transformers ACL 2020
Improving Transformer Optimization Through Better Initialization ICML 2020
PowerNorm: Rethinking Batch Normalization in Transformers ICML 2020
The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks NIPS 2019
SSN: Learning Sparse Switchable Normalization via SparsestMax CVPR 2019
Instance-Level Meta Normalization CVPR 2019
Root Mean Square Layer Normalization NIPS 2019
Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention EMNLP 2019
Learning Speaker Aware Offsets for Speaker Adaptation of Neural Networks INTERSPEECH 2019
Learning Deep Transformer Models for Machine Translation ACL 2019
Unsupervised Stylish Image Description Generation via Domain Layer Norm AAAI 2019
Normalization Helps Training of Quantized LSTM NIPS 2019
Understanding and Improving Layer Normalization NIPS 2019
Kalman Normalization: Normalizing Internal Representations Across Network Layers NIPS 2018
Dynamic Layer Normalization for Adaptive Neural Acoustic Modeling in Speech Recognition INTERSPEECH 2017