model compression

SlimSAM: 0.1% Data Makes Segment Anything Slim NeurIPS 2024 Smaller Language Models are capable of selecting Instruction-Tuning Training Data for Larger Language Models ACL 2024 Small Scale Data-Free Knowledge Distillation CVPR 2024 SmartTrim: Adaptive Tokens and Attention Pruning for Efficient Vision-Language Models COLING 2024 SnapKV: LLM Knows What You are Looking for Before Generation NeurIPS 2024 Soft Prompt Recovers Compressed LLMs, Transferably ICML 2024 SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model NeurIPS 2024 Some Like It Small: Czech Semantic Embedding Models for Industry Applications AAAI 2024 Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference EACL 2024 SpaFL: Communication-Efficient Federated Learning With Sparse Models And Low Computational Overhead NeurIPS 2024 SparseFlow: Accelerating Transformers by Sparsifying Information Flows ACL 2024 Sparse High Rank Adapters NeurIPS 2024 SparseLLM: Towards Global Pruning of Pre-trained Language Models NeurIPS 2024 Sparse maximal update parameterization: A holistic approach to sparse training dynamics NeurIPS 2024 SparseWAV: Fast and Accurate One-Shot Unstructured Pruning for Large Speech Foundation Models Interspeech 2024 Sparsity-Accelerated Training for Large Language Models ACL 2024 Speaker Change Detection with Weighted-sum Knowledge Distillation based on Self-supervised Pre-trained Models Interspeech 2024 Spear: Evaluate the Adversarial Robustness of Compressed Neural Models IJCAI 2024 SPECAT: SPatial-spEctral Cumulative-Attention Transformer for High-Resolution Hyperspectral Image Reconstruction CVPR 2024 Speedy Gonzales: A Collection of Fast Task-Specific Models for Spanish NAACL 2024 SpikedAttention: Training-Free and Fully Spike-Driven Transformer-to-SNN Conversion with Winner-Oriented Spike Shift for Softmax Operation NeurIPS 2024 SPIN: Sparsifying and Integrating Internal Neurons in Large Language Models for Text Classification ACL 2024 SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models EMNLP 2024 SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NeurIPS 2024 S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training NeurIPS 2024