linear transformer

Exploring Linear Variant Transformers and k-NN Memory Inference for Long-Form ASR Interspeech 2025 Graph Transformers Dream of Electric Flow ICLR 2025 Learning Advanced Self-Attention for Linear Transformers in the Singular Value Domain IJCAI 2025 Task Descriptors Help Transformers Learn Linear Models In-Context ICLR 2025 Trained Transformer Classifiers Generalize and Exhibit Benign Overfitting In-Context ICLR 2025 Do Efficient Transformers Really Save Computation? ICML 2024 In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization NeurIPS 2024 Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers AISTATS 2024 Learning and Transferring Sparse Contextual Bigrams with Linear Transformers NeurIPS 2024 Linear Transformers are Versatile In-Context Learners NeurIPS 2024 Linear Transformers with Learnable Kernel Functions are Better In-Context Models ACL 2024 Parallelizing Linear Transformers with the Delta Rule over Sequence Length NeurIPS 2024 Proxyformer: Nyström-Based Linear Transformer with Trainable Proxy Tokens AAAI 2024 Head-Free Lightweight Semantic Segmentation with Linear Transformer AAAI 2023 Practical Computational Power of Linear Transformers and Their Recurrent and Self-Referential Extensions EMNLP 2023 The Devil in Linear Transformer EMNLP 2022 Going Beyond Linear Transformers with Recurrent Fast Weight Programmers NeurIPS 2021 Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU EMNLP 2021