Skip to content
conftrace_

position encoding

60 papers

PE

Papers

DAPE: Harmonizing Content-Position Encoding for Versatile Dense Visual Prediction AAAI 2026 Exploring Position Encoding Mechanism in Diffusion U-Net for Training-free High-resolution Image Generation AAAI 2026 Position Encoding with Random Float Sampling Enhances Length Generalization of Transformers EACL 2026 SCOPE: Boosting LLM Efficiency with Scoped Position Encoding ACL 2026 Beyond Position: the emergence of wavelet-like properties in Transformers ACL 2025 Circuit Complexity Bounds for RoPE-based Transformer Architecture EMNLP 2025 Computation Mechanism Behind LLM Position Generalization ACL 2025 DAPE V2: Process Attention Score as Feature Map for Length Extrapolation ACL 2025 How Do Position Encodings Affect Length Generalization? Case Studies On In-Context Function Learning AAAI 2025 Linear Transformer Topological Masking with Graph Random Features ICLR 2025 LLM as Effective Streaming Processor: Bridging Streaming-Batch Mismatches with Group Position Encoding ACL 2025 LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models ACL 2025 OminiControl: Minimal and Universal Control for Diffusion Transformer ICCV 2025 PIC: Unlocking Long-Form Text Generation Capabilities of Large Language Models via Position ID Compression ACL 2025 Position IDs Matter: An Enhanced Position Layout for Efficient Context Compression in Large Language Models EMNLP 2025 TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning ICLR 2025 Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective COLING 2025 Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understanding CVPR 2025 VRoPE: Rotary Position Embedding for Video Large Language Models EMNLP 2025 Base of RoPE Bounds Context Length NeurIPS 2024 Effective Long-Context Scaling of Foundation Models NAACL 2024 ESM All-Atom: Multi-Scale Protein Language Model for Unified Molecular Modeling ICML 2024 Length Generalization of Causal Transformers without Position Encoding ACL 2024 LongEmbed: Extending Embedding Models for Long Context Retrieval EMNLP 2024 LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate NeurIPS 2024