conftrace_

sliding window attention

7 papers

Explore in graph

Co-occurring keywords

transformer architecture (1560) neighborhood attention (2) attention mechanism (4001) cuda kernel (3) memory bandwidth (8) fused kernel (1) translation equivariance (7) emotion classification (291) long-context modeling (34) causal language model (29)

Papers

Enhancing Image Restoration Transformer via Adaptive Translation Equivariance ICCV 2025
SWAMamba: A Sliding Window Attention Mamba Framework for Predicting Translation Elongation Rates AAAI 2025
Sample-Efficient Language Modeling with Linear Attention and Lightweight Enhancements EMNLP 2025
SWAN: An Efficient and Scalable Approach for Long-Context Language Modeling EMNLP 2025
Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level NIPS 2024
SWRR: Feature Map Classifier Based on Sliding Window Attention and High-Response Feature Reuse for Multimodal Emotion Recognition INTERSPEECH 2023
Neighborhood Attention Transformer CVPR 2023