conftrace_

transformer efficiency

13 papers

Explore in graph

Co-occurring keywords · papers mentioning both

model compression (5) model efficiency (4) efficient computing (3) sparse attention (3) token selection (2) neural network optimization (2) inference efficiency (2) linear attention (2) model optimization (2) attention sparsity (2)

Papers

Numerical Pruning for Efficient Autoregressive Models AAAI 2025 Principles of Visual Tokens for Efficient Video Understanding ICCV 2025 Smarter, Not Harder: Training-Free Adaptive Computation for Transformers ACL 2025 CItruS: Chunked Instruction-aware State Eviction for Long Sequence Modeling EMNLP 2024 The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry ICLR 2024 Fast Attention Requires Bounded Entries NeurIPS 2023 ClusterFormer: Neural Clustering Attention for Efficient and Effective Transformer ACL 2022 Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT ACL 2022 Linearizing Transformer with Key-Value Memory EMNLP 2022 Predicting Attention Sparsity in Transformers ACL 2022 Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selection ACL 2022 Sparsifying Transformer Models with Trainable Representation Pooling ACL 2022 Bag of Tricks for Optimizing Transformer Efficiency EMNLP 2021