Skip to content
conftrace_

merged attention

1 paper

Explore in graph

Also known as

MATT

Co-occurring keywords · papers mentioning both

depth-scaled initialization (1) encoder-decoder attention (1) deep transformer (1) layer normalization (1) residual connection (1) gradient vanishing (1) model convergence (1) deep neural network (1) machine translation (1)

Papers

Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention EMNLP 2019