relative positional encoding

Context-aware Biases for Length Extrapolation EMNLP 2025 On the Emergence of Position Bias in Transformers ICML 2025 Comparing Graph Transformers via Positional Encodings ICML 2024 Exploring Transformer Extrapolation AAAI 2024 Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers AISTATS 2024 LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024 MAT-SED: A Masked Audio Transformer with Masked-Reconstruction Based Pre-training for Sound Event Detection Interspeech 2024 Multi-resolution Time-Series Transformer for Long-term Forecasting AISTATS 2024 S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversation AACL 2022 Your Transformer May Not be as Powerful as You Expect NeurIPS 2022 Relative Positional Encoding for Transformers with Linear Complexity ICML 2021 Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding NeurIPS 2021 Polar Relative Positional Encoding for Video-Language Segmentation IJCAI 2020 Relative Positional Encoding for Speech Recognition and Direct Translation Interspeech 2020 Music Transformer: Generating Music with Long-Term Structure ICLR 2019