conftrace_

long sequence modeling

17 papers

Explore in graph

Co-occurring keywords

attention mechanism (4001) transformer architecture (1560) sparse attention (142) long sequence (30) state-space model (153) efficient computing (781) self-attention mechanism (352) transformer optimization (24) linear attention (52) sequence processing (24)

Papers

TreeKV: Smooth Key-Value Cache Compression with Tree Structures IJCAI 2025
MambaPro: Multi-Modal Object Re-identification with Mamba Aggregation and Synergistic Prompt AAAI 2025
Proxyformer: Nyström-Based Linear Transformer with Trainable Proxy Tokens AAAI 2024
CItruS: Chunked Instruction-aware State Eviction for Long Sequence Modeling EMNLP 2024
SMR: State Memory Replay for Long Sequence Modeling ACL 2024
Reparameterized Multi-Resolution Convolutions for Long Sequence Modelling NIPS 2024
LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory IJCAI 2024
Long Sequence Modeling with Attention Tensorization: From Sequence to Tensor Learning EMNLP 2024
VCC: Scaling Transformers to 128K Tokens or More by Prioritizing Important Tokens NIPS 2023
CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling ICML 2023
Resurrecting Recurrent Neural Networks for Long Sequences ICML 2023
Diffuser: Efficient Transformers with Multi-Hop Attention Diffusion for Long Sequences AAAI 2023
Adaptive Attention for Sparse-based Long-sequence Transformer ACL 2023
Investigating Efficiently Extending Transformers for Long Input Summarization EMNLP 2023
It’s Raw! Audio Generation with State-Space Models ICML 2022
Long-range Sequence Modeling with Predictable Sparse Attention ACL 2022
PermuteFormer: Efficient Relative Position Encoding for Long Sequences EMNLP 2021