Model Compression

SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models EMNLP 2024 SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NeurIPS 2024 S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training NeurIPS 2024 Steganographic Passport: An Owner and User Verifiable Credential for Deep Model IP Protection Without Retraining CVPR 2024 StepbaQ: Stepping backward as Correction for Quantized Diffusion Models NeurIPS 2024 Stepping Forward on the Last Mile NeurIPS 2024 Structured Unrestricted-Rank Matrices for Parameter Efficient Finetuning NeurIPS 2024 Study Selectively: An Adaptive Knowledge Distillation based on a Voting Network for Heart Sound Classification Interspeech 2024 Stylus: Automatic Adapter Selection for Diffusion Models NeurIPS 2024 SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention NeurIPS 2024 Taming Binarized Neural Networks and Mixed-Integer Programs AAAI 2024 Task-Aware Encoder Control for Deep Video Compression CVPR 2024 Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation AAAI 2024 TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models CVPR 2024 The False Promise of Imitating Proprietary Language Models ICLR 2024 The Mamba in the Llama: Distilling and Accelerating Hybrid Models NeurIPS 2024 The Trade-off between Performance, Efficiency, and Fairness in Adapter Modules for Text Classification NAACL 2024 The Ups and Downs of Large Language Model Inference with Vocabulary Trimming by Language Heuristics NAACL 2024 TinyLUT: Tiny Look-Up Table for Efficient Image Restoration at the Edge NeurIPS 2024 To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation ACL 2024 Token Fusion: Bridging the Gap Between Token Pruning and Token Merging WACV 2024 Torque Based Structured Pruning for Deep Neural Network WACV 2024 Toward Efficient Inference for Mixture of Experts NeurIPS 2024 Towards Accurate Post-training Quantization for Diffusion Models CVPR 2024 Towards Backward-Compatible Continual Learning of Image Compression CVPR 2024