conftrace_

positional encoding

182 papers

Explore in graph

Also known as

PE

Co-occurring keywords

attention mechanism (4001) transformer architecture (1560) graph neural network (3962) large language model (13587) context window (73) neural network (6616) language model (4599) self-attention mechanism (352) vision transformer (1106) length extrapolation (31)

Papers

Beyond RNNs: Positional Self-Attention with Co-Attention for Video Question Answering AAAI 2019
Language Modeling with Deep Transformers INTERSPEECH 2019
Positional Encoding to Control Output Sequence Length NAACL 2019
Novel positional encodings to enable tree-based transformers NIPS 2019
Self-Attention with Structural Position Representations IJCNLP 2019
Constituency Parsing with a Self-Attentive Encoder ACL 2018
Self-Attentional Acoustic Models INTERSPEECH 2018