Skip to content
conftrace_

relative position embedding

6 papers

Explore in graph

Also known as

RPE

Co-occurring keywords · papers mentioning both

position embedding (3) transformer architecture (2) sequence length generalization (1) anchor-based method (1) visual entailment (1) attention resolution (1) cross-modal position embedding (1) anchor-based embedding (1) transformer model (1) cross-modal transformer (1)

Papers

A Length-Extrapolatable Transformer ACL 2023 Bridging the Gap between Position-Based and Content-Based Self-Attention for Neural Machine Translation EMNLP 2023 An Anchor-based Relative Position Embedding Method for Cross-Modal Tasks EMNLP 2022 Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models ACL 2021 Explore Better Relative Position Embeddings from Encoding Perspective for Transformer Models EMNLP 2021 Improve Transformer Models with Better Relative Position Embeddings EMNLP 2020