Skip to content
conftrace_

fixed attention pattern

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

encoder self-attention (1) positional pattern (1) attention pattern (1) low-resource translation (1) multi-head attention (1) positional encoding (1) neural machine translation (1) machine translation (1) attention mechanism (1) transformer architecture (1)

Papers

Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation EMNLP 2020