conftrace_

rotary position embedding

32 papers

Explore in graph

Co-occurring keywords

attention mechanism (4001) large language model (13587) position encoding (54) positional encoding (182) context length (48) context window (73) length extrapolation (31) video understanding (1658) long context (121) context window extension (7)

Papers

RoSA: Enhancing Parameter-Efficient Fine-Tuning via RoPE-aware Selective Adaptation in Large Language Models AAAI 2026
Extending Audio Context for Long-Form Understanding in Large Audio-Language Models EACL 2026
Towards Long-window Anchoring in Vision-Language Model Distillation AAAI 2026
PEPE: Long-context Extension for Large Language Models via Periodic Extrapolation Positional Encodings EMNLP 2025
ComRoPE: Scalable and Robust Rotary Position Embedding Parameterized by Trainable Commuting Angle Matrices CVPR 2025
UNIC-Adapter: Unified Image-instruction Adapter with Multi-modal Transformer for Image Generation CVPR 2025
DynImg: Key Frames with Visual Prompts are Good Representation for Multi-Modal Video Understanding ICCV 2025
TC-LLaVA: Rethinking the Transfer of LLava from Image to Video Understanding with Temporal Considerations AAAI 2025
MASH-VLM: Mitigating Action-Scene Hallucination in Video-LLMs through Disentangled Spatial-Temporal Representations CVPR 2025
Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective COLING 2025
VRoPE: Rotary Position Embedding for Video Large Language Models EMNLP 2025
FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image Editing ICCV 2025
Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models COLING 2025
Extending LLM Context Window with Adaptive Grouped Positional Encoding: A Training-Free Method ACL 2025
The Rotary Position Embedding May Cause Dimension Inefficiency in Attention Heads for Long-Distance Retrieval ACL 2025
Advancing General Multimodal Capability of Vision-language Models with Pyramid-descent Visual Position Encoding ACL 2025
Beyond Position: the emergence of wavelet-like properties in Transformers ACL 2025
RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations IJCAI 2025
Base of RoPE Bounds Context Length NIPS 2024
CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending ACL 2024
PSC: Extending Context Window of Large Language Models via Phase Shift Calibration EMNLP 2024
Extending Context Window of Large Language Models from a Distributional Perspective EMNLP 2024
Fortify the Shortest Stave in Attention: Enhancing Context Awareness of Large Language Models for Effective Tool Use ACL 2024
LongEmbed: Extending Embedding Models for Long Context Retrieval EMNLP 2024
HiRoPE: Length Extrapolation for Code Models Using Hierarchical Position ACL 2024