Skip to content
conftrace_

position interpolation

5 papers

Explore in graph

Also known as

PI

Co-occurring keywords · papers mentioning both

large language model (2) positional encoding (2) language modeling (2) attention mechanism (2) relative position encoding (1) transformer model (1) long-context modeling (1) long context (1) rotary position encoding (1) length extrapolation (1)

Papers

Q-ROAR: Outlier-Aware Rescaling for RoPE Position Interpolation in Quantized Long-Context LLMs (Student Abstract) AAAI 2026 3D-RPE: Enhancing Long-Context Modeling Through 3D Rotary Position Encoding AAAI 2025 Functional Interpolation for Relative Positions improves Long Context Transformers ICLR 2024 Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding EMNLP 2024 PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training ICLR 2024