conftrace_

linear attention

52 papers

Explore in graph

Co-occurring keywords

language modeling (660) transformer architecture (1560) efficient computing (781) vision transformer (1106) state space model (390) attention mechanism (4001) language model (4599) image classification (1944) sequence modeling (288) long sequence (30)

Papers

PermuteFormer: Efficient Relative Position Encoding for Long Sequences EMNLP 2021
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention ICML 2020