conftrace_

long-range arena

9 papers

Explore in graph

Also known as

LRA

Co-occurring keywords · papers mentioning both

state space model (5) sequence modeling (3) transformer model (2) linear complexity (2) efficient computing (2) attention mechanism (2) model compression (2) computation complexity (1) moving average (1) top-k attention (1)

Papers

Short-Long Convolutions Help Hardware-Efficient Linear Attention to Focus on Long Sequences ICML 2024 State-Free Inference of State-Space Models: The *Transfer Function* Approach ICML 2024 Mega: Moving Average Equipped Gated Attention ICLR 2023 MSCFFN: A New FFN with Multi-Space Cross to Accelerate Transformer EMNLP 2023 Resurrecting Recurrent Neural Networks for Long Sequences ICML 2023 Simplified State Space Layers for Sequence Modeling ICLR 2023 FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention NeurIPS 2021 H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences ACL 2021 Memory-efficient Transformers via Top-k Attention EMNLP 2021