conftrace_

position embedding

61 papers

Explore in graph

Also known as

PE

Co-occurring keywords · papers mentioning both

attention mechanism (8) language model (6) transformer architecture (5) word order (4) language modeling (4) vision transformer (4) long context (3) relative position embedding (3) relative position (3) position encoding (3)

Papers

The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models ACL 2021 Encoding word order in complex embeddings ICLR 2020 Improve Transformer Models with Better Relative Position Embeddings EMNLP 2020 Increasing Learning Efficiency of Self-Attention Networks through Direct Position Interactions, Learnable Temperature, and Convoluted Attention COLING 2020 Neural Syntactic Preordering for Controlled Paraphrase Generation ACL 2020 What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding EMNLP 2020 Zero-shot Entity Linking with Efficient Long Range Sequence Modeling EMNLP 2020 Assessing the Ability of Self-Attention Networks to Learn Word Order ACL 2019 Learning protein sequence embeddings using information from structure ICLR 2019 Hierarchical Attention Based Position-Aware Network for Aspect-Level Sentiment Analysis CoNLL 2018 Attention-Based Convolutional Neural Network for Semantic Relation Extraction COLING 2016