model efficiency

FastViT: A Fast Hybrid Vision Transformer Using Structural Reparameterization ICCV 2023 Fcaformer: Forward Cross Attention in Hybrid Vision Transformer ICCV 2023 Improving End-to-End Modeling For Mandarin-English Code-Switching Using Lightweight Switch-Routing Mixture-of-Experts Interspeech 2023 Learning Expressive Prompting With Residuals for Vision Transformers CVPR 2023 Length-Adaptive Distillation: Customizing Small Language Model for Dynamic Token Pruning EMNLP 2023 Making Vision Transformers Efficient From a Token Sparsification View CVPR 2023 Meta Architecture for Point Cloud Analysis CVPR 2023 MobileNMT: Enabling Translation in 15MB and 30ms ACL 2023 MULLER: Multilayer Laplacian Resizer for Vision ICCV 2023 MUX-PLMs: Data Multiplexing for High-throughput Language Models EMNLP 2023 On the (In)Efficiency of Acoustic Feature Extractors for Self-Supervised Speech Representation Learning Interspeech 2023 PaCa-ViT: Learning Patch-to-Cluster Attention in Vision Transformers CVPR 2023 POTTER: Pooling Attention Transformer for Efficient Human Mesh Recovery CVPR 2023 Pre-RMSNorm and Pre-CRMSNorm Transformers: Equivalent and Efficient Pre-LN Transformers NeurIPS 2023 Pruning via Sparsity-indexed ODE: a Continuous Sparsity Viewpoint ICML 2023 RIFormer: Keep Your Vision Backbone Effective but Removing Token Mixer CVPR 2023 Robust Mixture-of-Expert Training for Convolutional Neural Networks ICCV 2023 Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks CVPR 2023 SlothSpeech: Denial-of-service Attack Against Speech Recognition Models Interspeech 2023 Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers CVPR 2023 SwiftFormer: Efficient Additive Attention for Transformer-based Real-time Mobile Vision Applications ICCV 2023 The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers ICLR 2023 TokenDrop + BucketSampler: Towards Efficient Padding-free Fine-tuning of Language Models EMNLP 2023 Token Merging: Your ViT But Faster ICLR 2023 When to Use Efficient Self Attention? Profiling Text, Speech and Image Transformer Variants ACL 2023