conftrace_

model efficiency

206 papers

Explore in graph

Co-occurring keywords

model compression (3302) efficient computing (781) vision transformer (1106) image classification (1944) large language model (13587) neural network optimization (1293) knowledge distillation (3725) convolutional neural network (4226) attention mechanism (4001) neural architecture search (666)

Papers

Investigating Acceleration of LLaMA Inference by Enabling Intermediate Layer Decoding via Instruction Tuning with ‘LITE’ NAACL 2024
SBCFormer: Lightweight Network Capable of Full-Size ImageNet Classification at 1 FPS on Single Board Computers WACV 2024
XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024
Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning ACL 2024
On the (In)Efficiency of Acoustic Feature Extractors for Self-Supervised Speech Representation Learning INTERSPEECH 2023
Bootstrapping Small & High Performance Language Models with Unmasking-Removal Training Policy EMNLP 2023
Length-Adaptive Distillation: Customizing Small Language Model for Dynamic Token Pruning EMNLP 2023
Beyond Attentive Tokens: Incorporating Token Importance and Diversity for Efficient Vision Transformers CVPR 2023
TokenDrop + BucketSampler: Towards Efficient Padding-free Fine-tuning of Language Models EMNLP 2023
SlothSpeech: Denial-of-service Attack Against Speech Recognition Models INTERSPEECH 2023
MobileNMT: Enabling Translation in 15MB and 30ms ACL 2023
Robust Mixture-of-Expert Training for Convolutional Neural Networks ICCV 2023
Pre-RMSNorm and Pre-CRMSNorm Transformers: Equivalent and Efficient Pre-LN Transformers NIPS 2023
SwiftFormer: Efficient Additive Attention for Transformer-based Real-time Mobile Vision Applications ICCV 2023
Fcaformer: Forward Cross Attention in Hybrid Vision Transformer ICCV 2023
DynamicDet: A Unified Dynamic Architecture for Object Detection CVPR 2023
POTTER: Pooling Attention Transformer for Efficient Human Mesh Recovery CVPR 2023
RIFormer: Keep Your Vision Backbone Effective but Removing Token Mixer CVPR 2023
Pruning via Sparsity-indexed ODE: a Continuous Sparsity Viewpoint ICML 2023
Improving End-to-End Modeling For Mandarin-English Code-Switching Using Lightweight Switch-Routing Mixture-of-Experts INTERSPEECH 2023
MULLER: Multilayer Laplacian Resizer for Vision ICCV 2023
Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translation EACL 2023
Brainformers: Trading Simplicity for Efficiency ICML 2023
FastViT: A Fast Hybrid Vision Transformer Using Structural Reparameterization ICCV 2023
Differentially Private Optimization on Large Model at Small Cost ICML 2023