conftrace_

sparse attention

142 papers

Explore in graph

Co-occurring keywords

attention mechanism (4001) efficient computing (781) transformer architecture (1560) large language model (13587) inference acceleration (244) vision transformer (1106) computational efficiency (362) self-attention mechanism (352) model compression (3302) multimodal learning (4645)

Papers

Dialogue State Tracking with Sparse Local Slot Attention ACL 2023
Summarizing Multiple Documents with Conversational Structure for Meta-Review Generation EMNLP 2023
Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers CVPR 2023
SViTT: Temporal Learning of Sparse Video-Text Transformers CVPR 2023
Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layer EMNLP 2023
Sparse Modular Activation for Efficient Sequence Modeling NIPS 2023
Fast Attention Over Long Sequences With Dynamic Sparse Flash Attention NIPS 2023
Predicting Attention Sparsity in Transformers ACL 2022
Revisiting Transformer-based Models for Long Document Classification EMNLP 2022
Beyond Characters: Subword-level Morpheme Segmentation NAACL 2022
Social-aware Sparse Attention Network for Session-based Social Recommendation EMNLP 2022
Speeding Up Entmax NAACL 2022
Two Languages Are Better than One: Bilingual Enhancement for Chinese Named Entity Recognition COLING 2022
Word-wise Sparse Attention for Multimodal Sentiment Analysis INTERSPEECH 2022
Read Extensively, Focus Smartly: A Cross-document Semantic Enhancement Method for Visual Documents NER COLING 2022
Vision Transformer With Deformable Attention CVPR 2022
Learning Adaptive Axis Attentions in Fine-tuning: Beyond Fixed Sparse Attention Patterns ACL 2022
DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization AAAI 2022
ClusterFormer: Neural Clustering Attention for Efficient and Effective Transformer ACL 2022
Neural Mesh Simplification CVPR 2022
Flow-Guided Sparse Transformer for Video Deblurring ICML 2022
Long-range Sequence Modeling with Predictable Sparse Attention ACL 2022
SparseTT: Visual Tracking with Sparse Transformers IJCAI 2022
Sparsifying Transformer Models with Trainable Representation Pooling ACL 2022
Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Cost NIPS 2022