conftrace_

relative positional encoding

12 papers

Explore in graph

Also known as

RPE

Co-occurring keywords

transformer architecture (1560) positional encoding (182) attention mechanism (4001) length extrapolation (31) local relative positional encoding (1) geometric datum (3) spatial relation (41) sound event detection (54) speech translation (416) positional bia (42)

Papers

Context-aware Biases for Length Extrapolation EMNLP 2025
Multi-resolution Time-Series Transformer for Long-term Forecasting AISTATS 2024
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers AISTATS 2024
MAT-SED: A Masked Audio Transformer with Masked-Reconstruction Based Pre-training for Sound Event Detection INTERSPEECH 2024
LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024
Exploring Transformer Extrapolation AAAI 2024
Your Transformer May Not be as Powerful as You Expect NIPS 2022
S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversation AACL 2022
Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding NIPS 2021
Relative Positional Encoding for Transformers with Linear Complexity ICML 2021
Relative Positional Encoding for Speech Recognition and Direct Translation INTERSPEECH 2020
Polar Relative Positional Encoding for Video-Language Segmentation IJCAI 2020