Model Compression

AlphaLoRA: Assigning LoRA Experts Based on Layer Training Quality EMNLP 2024 AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models NeurIPS 2024 ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models NeurIPS 2024 AlterMOMA: Fusion Redundancy Pruning for Camera-LiDAR Fusion Models with Alternative Modality Masking NeurIPS 2024 Ameliorate Spurious Correlations in Dataset Condensation ICML 2024 Anchor-based Large Language Models ACL 2024 An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient Language Model Inference EMNLP 2024 Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs ICML 2024 ApiQ: Finetuning of 2-Bit Quantized Large Language Model EMNLP 2024 Army of Thieves: Enhancing Black-Box Model Extraction via Ensemble Based Sample Selection WACV 2024 AS-ES Learning: Towards efficient CoT learning in small models ACL 2024 A Simple and Effective L_2 Norm-Based Strategy for KV Cache Compression EMNLP 2024 A Single Linear Layer Yields Task-Adapted Low-Rank Matrices COLING 2024 A Study of Parameter Efficient Fine-tuning by Learning to Efficiently Fine-Tune EMNLP 2024 A Taxonomy for Data Contamination in Large Language Models ACL 2024 ATQ: Activation Transformation forWeight-Activation Quantization of Large Language Models EMNLP 2024 Attention-Driven Training-Free Efficiency Enhancement of Diffusion Models CVPR 2024 Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch CVPR 2024 BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NeurIPS 2024 BarLeRIa: An Efficient Tuning Framework for Referring Image Segmentation ICLR 2024 BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation ICLR 2024 BiLLM: Pushing the Limit of Post-Training Quantization for LLMs ICML 2024 Binarized Low-light Raw Video Enhancement CVPR 2024 BIPEFT: Budget-Guided Iterative Search for Parameter Efficient Fine-Tuning of Large Pretrained Language Models EMNLP 2024 BitDelta: Your Fine-Tune May Only Be Worth One Bit NeurIPS 2024