conftrace_

sequence processing

24 papers

Explore in graph

Co-occurring keywords

neural network (6616) attention mechanism (4001) long sequence (30) sequence modeling (288) transformer architecture (1560) transformer model (1996) language model (4599) long sequence modeling (17) recurrent neural network (1790) short-term memory (18)

Papers

Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training NAACL 2025
What Makes Models Compositional? A Theoretical View IJCAI 2024
Perceiving Longer Sequences With Bi-Directional Cross-Attention Transformers NIPS 2024
Does the structure of textual content have an impact on language models for automatic summarization? ACL 2024
SMR: State Memory Replay for Long Sequence Modeling ACL 2024
Investigating Efficiently Extending Transformers for Long Input Summarization EMNLP 2023
Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies NIPS 2023
Recursion in Recursion: Two-Level Nested Recursion for Length Generalization with Scalability NIPS 2023
Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules NIPS 2022
Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences NAACL 2022
Recurrent Memory Transformer NIPS 2022
SFSRNet: Super-resolution for Single-Channel Audio Source Separation AAAI 2022
Residual Shuffle-Exchange Networks for Fast Processing of Long Sequences AAAI 2021
Are Transformers a Modern Version of ELIZA? Observations on French Object Verb Agreement EMNLP 2021
Controlled tasks for model analysis: Retrieving discrete information from sequences EMNLP 2021
Thinking Like Transformers ICML 2021
NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer ACL 2021
How Can Self-Attention Networks Recognize Dyck-n Languages? EMNLP 2020
Linear Dynamical Systems as a Core Computational Primitive NIPS 2020
Neural Shuffle-Exchange Networks - Sequence Processing in O(n log n) Time NIPS 2019
Word-order Biases in Deep-agent Emergent Communication ACL 2019
Sliced Recurrent Neural Networks COLING 2018
Distributed Sequence Memory of Multidimensional Inputs in Recurrent Networks JMLR 2017
Programming with a Differentiable Forth Interpreter ICML 2017