conftrace_

positional encoding

182 papers

Explore in graph

Also known as

PE

Co-occurring keywords

attention mechanism (4001) transformer architecture (1560) graph neural network (3962) large language model (13587) context window (73) neural network (6616) language model (4599) self-attention mechanism (352) vision transformer (1106) length extrapolation (31)

Papers

Positional Encoding As Spatial Inductive Bias in GANs CVPR 2021
DA-Transformer: Distance-aware Transformer NAACL 2021
Medical Image Segmentation using Squeeze-and-Expansion Transformers IJCAI 2021
ROPE: Reading Order Equivariant Positional Encoding for Graph-based Document Information Extraction IJCNLP 2021
Toward Spatially Unbiased Generative Models ICCV 2021
Cross-view Geo-localization with Layer-to-Layer Transformer NIPS 2021
CvT: Introducing Convolutions to Vision Transformers ICCV 2021
Stretch-VST: Getting Flexible With Visual Stories IJCNLP 2021
TNASP: A Transformer-based NAS Predictor with a Self-evolution Framework NIPS 2021
Beltrami Flow and Neural Diffusion on Graphs NIPS 2021
On the Computational Power of Transformers and Its Implications in Sequence Modeling CONLL 2020
Multiple Positional Self-Attention Network for Text Classification AAAI 2020
PoD: Positional Dependency-Based Word Embedding for Aspect Term Extraction COLING 2020
Cascaded Semantic and Positional Self-Attention Network for Document Classification EMNLP 2020
Infinite attention: NNGP and NTK for deep attention networks ICML 2020
What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding EMNLP 2020
Lightweight Text Classifier using Sinusoidal Positional Encoding AACL 2020
Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation EMNLP 2020
On the Computational Power of Transformers and Its Implications in Sequence Modeling EMNLP 2020
Discourse Self-Attention for Discourse Element Identification in Argumentative Student Essays EMNLP 2020
Self-Attentive Hawkes Process ICML 2020
Polar Relative Positional Encoding for Video-Language Segmentation IJCAI 2020
Incorporating Noisy Length Constraints into Transformer with Length-aware Positional Encodings COLING 2020
On the Ability and Limitations of Transformers to Recognize Formal Languages EMNLP 2020
Transformer-XL: Attentive Language Models beyond a Fixed-Length Context ACL 2019