conftrace_

position embedding

46 papers

Explore in graph

Also known as

PE

Co-occurring keywords

attention mechanism (4001) language model (4599) transformer architecture (1560) relative position embedding (7) relative position (9) position encoding (54) self-attention mechanism (352) vision transformer (1106) layer normalization (65) large language model (13587)

Papers

FQ-PETR: Fully Quantized Position Embedding Transformation for Multi-View 3D Object Detection AAAI 2026
Maximizing the Position Embedding for Vision Transformers with Global Average Pooling AAAI 2025
PIC: Unlocking Long-Form Text Generation Capabilities of Large Language Models via Position ID Compression ACL 2025
Mamba-3VL: Taming State Space Model for 3D Vision Language Learning ICCV 2025
Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks ICCV 2025
Design Choices for Extending the Context Length of Visual Language Models ACL 2025
Less-to-More Generalization: Unlocking More Controllability by In-Context Generation ICCV 2025
Mixture of In-Context Experts Enhance LLMs' Long Context Awareness NIPS 2024
An Exploration of Length Generalization in Transformer-Based Speech Enhancement INTERSPEECH 2024
Learned Transformer Position Embeddings Have a Low-Dimensional Structure ACL 2024
POP-CEE: Position-oriented Prompt-tuning Model for Causal Emotion Entailment ACL 2024
Masked Hard-Attention Transformers Recognize Exactly the Star-Free Languages NIPS 2024
DVPE: Divided View Position Embedding for Multi-View 3D Object Detection IJCAI 2024
ElasTST: Towards Robust Varied-Horizon Forecasting with Elastic Time-Series Transformer NIPS 2024
Transformers Can Do Arithmetic with the Right Embeddings NIPS 2024
Position Matters! Empirical Study of Order Effect in Knowledge-grounded Dialogue ACL 2023
CAPE: Camera View Position Embedding for Multi-View 3D Object Detection CVPR 2023
Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformers CVPR 2023
Absolute Position Embedding Learns Sinusoid-like Waves for Attention Based on Relative Position EMNLP 2023
LaPE: Layer-adaptive Position Embedding for Vision Transformers with Independent Layer Normalization ICCV 2023
A Length-Extrapolatable Transformer ACL 2023
Large-Scale Person Detection and Localization Using Overhead Fisheye Cameras ICCV 2023
Word Order Does Matter and Shuffled Language Models Know It ACL 2022
XYLayoutLM: Towards Layout-Aware Multimodal Networks for Visually-Rich Document Understanding CVPR 2022
Position Prediction as an Effective Pretraining Strategy ICML 2022