linear complexity

PoNet: Pooling Network for Efficient Token Mixing in Long Sequences ICLR 2022 Quadtree Attention for Vision Transformers ICLR 2022 Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences NAACL 2022 Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Cost NeurIPS 2022 FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention NeurIPS 2021 Generalizable Multi-linear Attention Network NeurIPS 2021 H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences ACL 2021 Long-Short Transformer: Efficient Transformers for Language and Vision NeurIPS 2021 Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding ICCV 2021 Poly-NL: Linear Complexity Non-Local Layers With 3rd Order Polynomials ICCV 2021 Relative Positional Encoding for Transformers with Linear Complexity ICML 2021 Rethinking Attention with Performers ICLR 2021 SOFT: Softmax-free Transformer with Linear Complexity NeurIPS 2021 XCiT: Cross-Covariance Image Transformers NeurIPS 2021 You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling ICML 2021 Efficient Clustering Based On A Unified View Of K-means And Ratio-cut NeurIPS 2020 Fast Transformers with Clustered Attention NeurIPS 2020 Large-Scale Multi-View Subspace Clustering in Linear Time AAAI 2020 Time-aware Large Kernel Convolutions ICML 2020 A Theoretically Sound Upper Bound on the Triplet Loss for Improving the Efficiency of Deep Distance Metric Learning CVPR 2019 Fast and Robust Multi-View Multi-Task Learning via Group Sparsity IJCAI 2019 Star-Transformer NAACL 2019 Full Flow: Optical Flow Estimation By Global Optimization Over Regular Grids CVPR 2016 Top Rank Optimization in Linear Time NeurIPS 2014