Model Compression

Dual-Space Knowledge Distillation for Large Language Models EMNLP 2024 DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs NeurIPS 2024 Dynamic Sparse Training with Structured Sparsity ICLR 2024 ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models ICLR 2024 Edge Inference With Fully Differentiable Quantized Mixed Precision Neural Networks WACV 2024 Efficient CNNs with Quaternion Transformations and Pruning for Audio Tagging Interspeech 2024 Efficient Deweahter Mixture-of-Experts with Uncertainty-Aware Feature-Wise Linear Modulation AAAI 2024 Efficient End-to-End Visual Document Understanding with Rationale Distillation NAACL 2024 Efficient Low-Dimensional Compression of Overparameterized Models AISTATS 2024 Efficient Multitask Dense Predictor via Binarization CVPR 2024 Efficient Multi-task LLM Quantization and Serving for Multiple LoRA Adapters NeurIPS 2024 EFTNAS: Searching for Efficient Language Models in First-Order Weight-Reordered Super-Networks COLING 2024 Eigen Attention: Attention in Low-Rank Space for KV Cache Compression EMNLP 2024 ELAD: Explanation-Guided Large Language Models Active Distillation ACL 2024 Elastic Weight Removal for Faithful and Abstractive Dialogue Generation NAACL 2024 Enhancing In-Context Learning Performance with just SVD-Based Weight Pruning: A Theoretical Perspective NeurIPS 2024 EnOF-SNN: Training Accurate Spiking Neural Networks via Enhancing the Output Feature NeurIPS 2024 ESPACE: Dimensionality Reduction of Activations for Model Compression NeurIPS 2024 Evolving Subnetwork Training for Large Language Models ICML 2024 ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking ICML 2024 Expanding Sparse Tuning for Low Memory Usage NeurIPS 2024 Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion NeurIPS 2024 Exploring compressibility of transformer based text-to-music (TTM) models Interspeech 2024 Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation AAAI 2024 Extending Context Window of Large Language Models from a Distributional Perspective EMNLP 2024