linear attention

cosFormer: Rethinking Softmax In Attention ICLR 2022 Flowformer: Linearizing Transformers with Conservation Flows ICML 2022 Hybrid Random Features ICLR 2022 Improving Transformers with Probabilistic Attention Keys ICML 2022 Linearizing Transformer with Key-Value Memory EMNLP 2022 Meta-Learning Fast Weight Language Models EMNLP 2022 Modeling Context With Linear Attention for Scalable Document-Level Translation EMNLP 2022 Resource-Efficient Hybrid X-Formers for Vision WACV 2022 Transformer Quality in Linear Time ICML 2022 LinearSpeech: Parallel Text-to-Speech with Linear Complexity Interspeech 2021 Linear Transformers Are Secretly Fast Weight Programmers ICML 2021 PermuteFormer: Efficient Relative Position Encoding for Long Sequences EMNLP 2021 Sub-Linear Memory: How to Make Performers SLiM NeurIPS 2021 Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention ICML 2020