Papers
DiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography Reconstruction
Bowen Song, Jason Hu, Zhaoxu Luo et al.
Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training
Junqing He, Kunhao Pan, Xiaoqun Dong et al.
POP-CEE: Position-oriented Prompt-tuning Model for Causal Emotion Entailment
Zhihan Zhou, Xue Gu, Yujie Zhao et al.
Multilevel Position-aware Attention Enhanced Network for Skeleton-Based Action Recognition
Dandan Zhang, Jia Wang, Sicong Zhan
PARE-Net: Position-Aware Rotation-Equivariant Networks for Robust Point Cloud Registration
Runzhao Yao, Shaoyi Du, Wenting Cui et al.
Position Engineering: Boosting Large Language Models through Positional Information Manipulation
Zhiyuan He, Huiqiang Jiang, Zilong Wang et al.
PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awareness
Noah Wang, Feiyu Duan, Yibo Zhang et al.
Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation Space
Erik J Bekkers, Sharvaree Vadgama, Rob Hesselink et al.
COVID19 to Pneumonia: Multi Region Lung Severity Classification using CNN Transformer Position-Aware Feature Encoding Network
Jong Bub Lee, Jung Soo Kim, Hyun Gyu Lee
Position-Guided Prompt Learning for Anomaly Detection in Chest X-Rays
Zhichao Sun, Yuliang Gu, Yepeng Liu et al.
Exploring Context Window of Large Language Models via Decomposed Positional Vectors
Zican Dong, Junyi Li, Xin Men et al.
Position Coupling: Improving Length Generalization of Arithmetic Transformers Using Task Structure
Hanseul Cho, Jaeyoung Cha, Pranjal Awasthi et al.
DAPE: Data-Adaptive Positional Encoding for Length Extrapolation
Chuanyang Zheng, Yihang Gao, Han Shi et al.
Algebraic Positional Encodings
Konstantinos Kogkalidis, Jean-Philippe Bernardy, Vikas Garg
A Phase Transition between Positional and Semantic Learning in a Solvable Model of Dot-Product Attention
Hugo Cui, Freya Behrens, Florent Krzakala et al.
An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding
Tong Wu, Yanpeng Zhao, Zilong Zheng
Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
Zhenyu Zhang, Runjin Chen, Shiwei Liu et al.
Mesa-Extrapolation: A Weave Position Encoding Method for Enhanced Extrapolation in LLMs
Xin Ma, Yang Liu, Jingjing Liu et al.
Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Masking
Zijian Dong, Ruilin Li, Yilei Wu et al.
TAPTRv2: Attention-based Position Update Improves Tracking Any Point
Hongyang Li, Hao Zhang, Shilong Liu et al.
GIN-SD: Source Detection in Graphs with Incomplete Nodes via Positional Encoding and Attentive Fusion
Le Cheng, Peican Zhu, Keke Tang et al.
PosDiffNet: Positional Neural Diffusion for Point Cloud Registration in a Large Field of View with Perturbations
Rui She, Sijie Wang, Qiyu Kang et al.
Improved MLP Point Cloud Processing with High-Dimensional Positional Encoding
Yanmei Zou, Hongshan Yu, Zhengeng Yang et al.
Learning Multi-Object Positional Relationships via Emergent Communication
Yicheng Feng, Boshi An, Zongqing Lu