Co-occurring keywords · papers mentioning both
Papers
DeciMamba: Exploring the Length Extrapolation Potential of Mamba
ICLR 2025
Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training
NAACL 2025
Does the structure of textual content have an impact on language models for automatic summarization?
ACL 2024
Perceiving Longer Sequences With Bi-Directional Cross-Attention Transformers
NeurIPS 2024
SMR: State Memory Replay for Long Sequence Modeling
ACL 2024
What Makes Models Compositional? A Theoretical View
IJCAI 2024
Investigating Efficiently Extending Transformers for Long Input Summarization
EMNLP 2023
Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies
NeurIPS 2023
Recursion in Recursion: Two-Level Nested Recursion for Length Generalization with Scalability
NeurIPS 2023
Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules
NeurIPS 2022
Recurrent Memory Transformer
NeurIPS 2022
SFSRNet: Super-resolution for Single-Channel Audio Source Separation
AAAI 2022
Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences
NAACL 2022
Are Transformers a Modern Version of ELIZA? Observations on French Object Verb Agreement
EMNLP 2021
Controlled tasks for model analysis: Retrieving discrete information from sequences
EMNLP 2021
Residual Shuffle-Exchange Networks for Fast Processing of Long Sequences
AAAI 2021
The Recurrent Neural Tangent Kernel
ICLR 2021
Thinking Like Transformers
ICML 2021
How Can Self-Attention Networks Recognize Dyck-n Languages?
EMNLP 2020
Linear Dynamical Systems as a Core Computational Primitive
NeurIPS 2020
Neural Shuffle-Exchange Networks - Sequence Processing in O(n log n) Time
NeurIPS 2019
Word-order Biases in Deep-agent Emergent Communication
ACL 2019
Sliced Recurrent Neural Networks
COLING 2018
Distributed Sequence Memory of Multidimensional Inputs in Recurrent Networks
JMLR 2017
Programming with a Differentiable Forth Interpreter
ICML 2017