conftrace_

positional encoding

182 papers

Explore in graph

Also known as

PE

Co-occurring keywords

attention mechanism (4001) transformer architecture (1560) graph neural network (3962) large language model (13587) context window (73) neural network (6616) language model (4599) self-attention mechanism (352) vision transformer (1106) length extrapolation (31)

Papers

The Impact of Positional Encoding on Length Generalization in Transformers NIPS 2023
Absolute Position Embedding Learns Sinusoid-like Waves for Attention Based on Relative Position EMNLP 2023
The Locality and Symmetry of Positional Encodings EMNLP 2023
Latent Positional Information is in the Self-Attention Variance of Transformer Language Models Without Positional Embeddings ACL 2023
Towards More Efficient Insertion Transformer with Fractional Positional Encoding EACL 2023
OctFormer: Efficient Octree-Based Transformer for Point Cloud Compression with Local Enhancement AAAI 2023
DPText-DETR: Towards Better Scene Text Detection with Dynamic Points in Transformer AAAI 2023
Polynomial Implicit Neural Representations for Large Diverse Datasets CVPR 2023
Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection AAAI 2023
Geometric Transformer with Interatomic Positional Encoding NIPS 2023
Are Transformers Effective for Time Series Forecasting? AAAI 2023
Defending Backdoor Attacks on Vision Transformer via Patch Processing AAAI 2023
Positional Label for Self-Supervised Vision Transformer AAAI 2023
Graph Inductive Biases in Transformers without Message Passing ICML 2023
Customized Positional Encoding to Combine Static and Time-varying Data in Robust Representation Learning for Crop Yield Prediction IJCAI 2023
Interpreting Positional Information in Perspective of Word Order ACL 2023
PINs: Progressive Implicit Networks for Multi-Scale Neural Representations ICML 2022
A-TIP: Attribute-aware Text Infilling via Pre-trained Language Model COLING 2022
Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning NAACL 2022
Geometric Transformer for End-to-End Molecule Properties Prediction IJCAI 2022
Positional Encoding for Capturing Modality Specific Cadence for Emotion Detection INTERSPEECH 2022
S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversation IJCNLP 2022
Transformer Language Models without Positional Encodings Still Learn Positional Information EMNLP 2022
Structure-Aware Transformer for Graph Representation Learning ICML 2022
Rethinking Positional Encoding in Tree Transformer for Code Representation EMNLP 2022