conftrace_

position encoding

54 papers

Explore in graph

Also known as

PE

Co-occurring keywords

large language model (13587) attention mechanism (4001) transformer architecture (1560) rotary position embedding (32) self-attention mechanism (352) length generalization (29) transformer model (1996) neural network (6616) positional encoding (182) language model (4599)

Papers

Exploring Position Encoding Mechanism in Diffusion U-Net for Training-free High-resolution Image Generation AAAI 2026
Position Encoding with Random Float Sampling Enhances Length Generalization of Transformers EACL 2026
SCOPE: Boosting LLM Efficiency with Scoped Position Encoding ACL 2026
DAPE: Harmonizing Content-Position Encoding for Versatile Dense Visual Prediction AAAI 2026
PIC: Unlocking Long-Form Text Generation Capabilities of Large Language Models via Position ID Compression ACL 2025
Position IDs Matter: An Enhanced Position Layout for Efficient Context Compression in Large Language Models EMNLP 2025
Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understanding CVPR 2025
Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective COLING 2025
VRoPE: Rotary Position Embedding for Video Large Language Models EMNLP 2025
Circuit Complexity Bounds for RoPE-based Transformer Architecture EMNLP 2025
How Do Position Encodings Affect Length Generalization? Case Studies On In-Context Function Learning AAAI 2025
OminiControl: Minimal and Universal Control for Diffusion Transformer ICCV 2025
LLM as Effective Streaming Processor: Bridging Streaming-Batch Mismatches with Group Position Encoding ACL 2025
Beyond Position: the emergence of wavelet-like properties in Transformers ACL 2025
DAPE V2: Process Attention Score as Feature Map for Length Extrapolation ACL 2025
Computation Mechanism Behind LLM Position Generalization ACL 2025
LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models ACL 2025
Base of RoPE Bounds Context Length NIPS 2024
Mesa-Extrapolation: A Weave Position Encoding Method for Enhanced Extrapolation in LLMs NIPS 2024
Resonance RoPE: Improving Context Length Generalization of Large Language Models ACL 2024
LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate NIPS 2024
LongEmbed: Extending Embedding Models for Long Context Retrieval EMNLP 2024
PSC: Extending Context Window of Large Language Models via Phase Shift Calibration EMNLP 2024
Effective Long-Context Scaling of Foundation Models NAACL 2024
Length Generalization of Causal Transformers without Position Encoding ACL 2024