Skip to content
conftrace_

efficient attention

21 papers

Papers

Efficiency Follows Global-Local Decoupling CVPR 2026 RAPTOR: Real-Time High-Resolution UAV Video Prediction with Efficient Video Attention AAAI 2026 Stop Looking for “Important Tokens” in Multimodal Language Models: Duplication Matters More EMNLP 2025 Jargon: A Suite of Language Models and Evaluation Tasks for French Specialized Domains COLING 2024 PLDNet: PLD-Guided Lightweight Deep Network Boosted by Efficient Attention for Handheld Dual-Microphone Speech Enhancement Interspeech 2024 X-former Elucidator: Reviving Efficient Attention for Long Context Language Modeling IJCAI 2024 CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling ICML 2023 CoLT5: Faster Long-Range Transformers with Conditional Computation EMNLP 2023 Efficient Transformer Knowledge Distillation: A Performance Review EMNLP 2023 Efficient-VQGAN: Towards High-Resolution Image Generation with Efficient Vision Transformers ICCV 2023 Focus on the Core: Efficient Attention via Pruned Token Compression for Document Classification EMNLP 2023 SwiftFormer: Efficient Additive Attention for Transformer-based Real-time Mobile Vision Applications ICCV 2023 Fast Vision Transformers with HiLo Attention NeurIPS 2022 Learned Queries for Efficient Local Attention CVPR 2022 MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens CVPR 2022 Ripple Attention for Visual Perception with Sub-quadratic Complexity ICML 2022 Simple Local Attentions Remain Competitive for Long-Context Tasks NAACL 2022 Efficient Attention: Attention With Linear Complexities WACV 2021 Efficient Attentions for Long Document Summarization NAACL 2021 Neural Machine Translation with Joint Representation AAAI 2020 SMYRF - Efficient Attention using Asymmetric Clustering NeurIPS 2020