positional encoding

Why Are Positional Encodings Nonessential for Deep Autoregressive Transformers? A Petroglyph Revisited ACL 2025 A 2-Dimensional State Space Layer for Spatial Inductive Bias ICLR 2024 Activating Self-Attention for Multi-Scene Absolute Pose Regression NeurIPS 2024 Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators NeurIPS 2024 Algebraic Positional Encodings NeurIPS 2024 Aligning Transformers with Weisfeiler-Leman ICML 2024 A Morphology-Based Investigation of Positional Encodings EMNLP 2024 An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding NeurIPS 2024 Base of RoPE Bounds Context Length NeurIPS 2024 BEACON: Benchmark for Comprehensive RNA Tasks and Language Models NeurIPS 2024 Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models IJCAI 2024 Comparing Graph Transformers via Positional Encodings ICML 2024 DAPE: Data-Adaptive Positional Encoding for Length Extrapolation NeurIPS 2024 Dependency Transformer Grammars: Integrating Dependency Structures into Transformer Language Models ACL 2024 Distinguished In Uniform: Self-Attention Vs. Virtual Nodes ICLR 2024 Effective Structural Encodings via Local Curvature Profiles ICLR 2024 Enhancing Graph Transformers with Hierarchical Distance Structural Encoding NeurIPS 2024 Enhancing Video Super-Resolution via Implicit Resampling-based Alignment CVPR 2024 Exploring Context Window of Large Language Models via Decomposed Positional Vectors NeurIPS 2024 Extending Context Window of Large Language Models from a Distributional Perspective EMNLP 2024 Fast Tree-Field Integrators: From Low Displacement Rank to Topological Transformers NeurIPS 2024 Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding NeurIPS 2024 GIN-SD: Source Detection in Graphs with Incomplete Nodes via Positional Encoding and Attentive Fusion AAAI 2024 Graph Positional and Structural Encoder ICML 2024 GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers ICLR 2024