Papers
LongCoder: A Long-Range Pre-trained Language Model for Code Completion
Daya Guo, Canwen Xu, Nan Duan et al.
Online learning of long-range dependencies
Nicolas Zucchet, Robert Meier, Simon Schug et al.
WITRAN: Water-wave Information Transmission and Recurrent Acceleration Network for Long-range Time Series Forecasting
Yuxin Jia, Youfang Lin, Xinyan Hao et al.
Cognitive Steering in Deep Neural Networks via Long-Range Modulatory Feedback Connections
Talia Konkle, George Alvarez
Unlimiformer: Long-Range Transformers with Unlimited Length Input
Amanda Bertsch, Uri Alon, Graham Neubig et al.
Differentiable and Stable Long-Range Tracking of Multiple Posterior Modes
Ali Younis, Erik B. Sudderth
HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution
Eric Nguyen, Michael Poli, Marjan Faizi et al.
MeGraph: Capturing Long-Range Interactions by Alternating Local and Hierarchical Aggregation on Multi-Scaled Graph Hierarchy
Honghua Dong, Jiawei Xu, Yu Yang et al.
Convolutional State Space Models for Long-Range Spatiotemporal Modeling
Jimmy Smith, Shalini De Mello, Jan Kautz et al.
ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Construction
Jingyi Yu, Zizhao Zhang, Shengfu Xia et al.
PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Prediction
Jiawei Jiang, Chengkai Han, Wayne Xin Zhao et al.
Long-Range Graph U-Nets: Node and Edge Clustering Pooling Model For Stroke Classification in Online Handwritten Documents
Muwu Yao, Shuang She, Jinrong Li et al.
Seeing With Sound: Long-range Acoustic Beamforming for Multimodal Scene Understanding
Praneeth Chakravarthula, Jim Aldon D’Souza, Ethan Tseng et al.
The NLP Task Effectiveness of Long-Range Transformers
Guanghui Qin, Yukun Feng, Benjamin Van Durme
CoLT5: Faster Long-Range Transformers with Conditional Computation
Joshua Ainslie, Tao Lei, Michiel de Jong et al.
Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layer
Qingru Zhang, Dhananjay Ram, Cole Hawkins et al.
Long-Range Language Modeling with Selective Cache
Xinting Huang, Nora Hollenstein
TRAMS: Training-free Memory Selection for Long-range Language Modeling
Haofei Yu, Cunxiang Wang, Yue Zhang et al.
Long-Range Grouping Transformer for Multi-View 3D Reconstruction
Liying Yang, Zhenwei Zhu, Xuxin Lin et al.
Long-range Multimodal Pretraining for Movie Understanding
Dawit Mureja Argaw, Joon-Young Lee, Markus Woodson et al.
V-FUSE: Volumetric Depth Map Fusion with Long-Range Constraints
Nathaniel Burgdorfer, Philippos Mordohai
Learning Long-Range Information with Dual-Scale Transformers for Indoor Scene Completion
Ziqi Wang, Fei Luo, Xiaoxiao Long et al.
AccFlow: Backward Accumulation for Long-Range Optical Flow
Guangyang Wu, Xiaohong Liu, Kunming Luo et al.
Anisotropic Message Passing: Graph Neural Networks with Directional and Long-Range Interactions
Moritz Thürlemann, Sereina Riniker
Ewald-based Long-Range Message Passing for Molecular Graphs
Arthur Kosmala, Johannes Gasteiger, Nicholas Gao et al.