Co-occurring keywords · papers mentioning both
Papers
DAPE: Harmonizing Content-Position Encoding for Versatile Dense Visual Prediction
AAAI 2026
Exploring Position Encoding Mechanism in Diffusion U-Net for Training-free High-resolution Image Generation
AAAI 2026
Position Encoding with Random Float Sampling Enhances Length Generalization of Transformers
EACL 2026
SCOPE: Boosting LLM Efficiency with Scoped Position Encoding
ACL 2026
Beyond Position: the emergence of wavelet-like properties in Transformers
ACL 2025
Circuit Complexity Bounds for RoPE-based Transformer Architecture
EMNLP 2025
Computation Mechanism Behind LLM Position Generalization
ACL 2025
DAPE V2: Process Attention Score as Feature Map for Length Extrapolation
ACL 2025
How Do Position Encodings Affect Length Generalization? Case Studies On In-Context Function Learning
AAAI 2025
Linear Transformer Topological Masking with Graph Random Features
ICLR 2025
LLM as Effective Streaming Processor: Bridging Streaming-Batch Mismatches with Group Position Encoding
ACL 2025
LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
ACL 2025
OminiControl: Minimal and Universal Control for Diffusion Transformer
ICCV 2025
PIC: Unlocking Long-Form Text Generation Capabilities of Large Language Models via Position ID Compression
ACL 2025
Position IDs Matter: An Enhanced Position Layout for Efficient Context Compression in Large Language Models
EMNLP 2025
TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning
ICLR 2025
Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective
COLING 2025
Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understanding
CVPR 2025
VRoPE: Rotary Position Embedding for Video Large Language Models
EMNLP 2025
Base of RoPE Bounds Context Length
NeurIPS 2024
Effective Long-Context Scaling of Foundation Models
NAACL 2024
ESM All-Atom: Multi-Scale Protein Language Model for Unified Molecular Modeling
ICML 2024
Length Generalization of Causal Transformers without Position Encoding
ACL 2024
LongEmbed: Extending Embedding Models for Long Context Retrieval
EMNLP 2024
LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate
NeurIPS 2024