conftrace_

long sequence

36 papers

Explore in graph

Co-occurring keywords · papers mentioning both

attention mechanism (9) transformer architecture (8) sequence modeling (6) transformer model (5) self-attention mechanism (5) sequence processing (4) linear attention (4) long sequence modeling (4) linear complexity (4) computational complexity (4)

Papers

Large Sequence Representation Learning via Multi-Stage Latent Transformers COLING 2022 LongT5: Efficient Text-To-Text Transformer for Long Sequences NAACL 2022 PoNet: Pooling Network for Efficient Token Mixing in Long Sequences ICLR 2022 Recurrent Memory Transformer NeurIPS 2022 Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences NAACL 2022 The Devil in Linear Transformer EMNLP 2022 Beyond Paragraphs: NLP for Long Sequences NAACL 2021 Detect Profane Language in Streaming Services to Protect Young Audiences ACL 2021 PermuteFormer: Efficient Relative Position Encoding for Long Sequences EMNLP 2021 Residual Shuffle-Exchange Networks for Fast Processing of Long Sequences AAAI 2021 Generating Wikipedia by Summarizing Long Sequences ICLR 2018