model efficiency

MediSwift: Efficient Sparse Pre-trained Biomedical Language Models ACL 2024 Multi-criteria Token Fusion with One-step-ahead Attention for Efficient Vision Transformers CVPR 2024 Parsimony or Capability? Decomposition Delivers Both in Long-term Time Series Forecasting NeurIPS 2024 Predicting Rewards Alongside Tokens: Non-disruptive Parameter Insertion for Efficient Inference Intervention in Large Language Model EMNLP 2024 Preparing Lessons for Progressive Training on Language Models AAAI 2024 QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion NeurIPS 2024 RepTor: Re-parameterizable Temporal Convolution for Keyword Spotting via Differentiable Kernel Search Interspeech 2024 Rethinking Token Reduction for State Space Models EMNLP 2024 SBCFormer: Lightweight Network Capable of Full-Size ImageNet Classification at 1 FPS on Single Board Computers WACV 2024 Spectral Adapter: Fine-Tuning in Spectral Space NeurIPS 2024 Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning ACL 2024 Symmetric Dot-Product Attention for Efficient Training of BERT Language Models ACL 2024 Turn Waste into Worth: Rectifying Top-k Router of MoE EMNLP 2024 XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024 You Only Need Less Attention at Each Stage in Vision Transformers CVPR 2024 An efficient encoder-decoder architecture with top-down attention for speech separation ICLR 2023 Beyond Attentive Tokens: Incorporating Token Importance and Diversity for Efficient Vision Transformers CVPR 2023 Bootstrapping Small & High Performance Language Models with Unmasking-Removal Training Policy EMNLP 2023 Brainformers: Trading Simplicity for Efficiency ICML 2023 Differentially Private Optimization on Large Model at Small Cost ICML 2023 DiffRate : Differentiable Compression Rate for Efficient Vision Transformers ICCV 2023 DynamicDet: A Unified Dynamic Architecture for Object Detection CVPR 2023 EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation Metrics EMNLP 2023 Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translation EACL 2023 Efficient Grammatical Error Correction Via Multi-Task Training and Optimized Training Schedule EMNLP 2023