Model Compression

NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models ACL 2024 Norm Tweaking: High-Performance Low-Bit Quantization of Large Language Models AAAI 2024 Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models ACL 2024 Not Everything is All You Need: Toward Low-Redundant Optimization for Large Language Model Alignment EMNLP 2024 Once for Both: Single Stage of Importance and Sparsity Search for Vision Transformer Compression CVPR 2024 OneBit: Towards Extremely Low-bit Large Language Models NeurIPS 2024 One-Step Forward and Backtrack: Overcoming Zig-Zagging in Loss-Aware Quantization Training AAAI 2024 On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm CVPR 2024 On the Impact of Calibration Data in Post-training Quantization and Pruning ACL 2024 On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving CVPR 2024 Optimal Eye Surgeon: Finding image priors through sparse generators at initialization ICML 2024 Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs EMNLP 2024 Orthogonal Adaptation for Modular Customization of Diffusion Models CVPR 2024 Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation NeurIPS 2024 Parameter Competition Balancing for Model Merging NeurIPS 2024 Parameter Efficient Fine-tuning via Cross Block Orchestration for Segment Anything Model CVPR 2024 PARA: Parameter-Efficient Fine-tuning with Prompt-Aware Representation Adjustment EMNLP 2024 Partial Binarization of Neural Networks for Budget-Aware Efficient Learning WACV 2024 PartialFormer: Modeling Part Instead of Whole for Machine Translation ACL 2024 PEK: A Parameter-Efficient Framework for Knowledge-Grounded Dialogue Generation ACL 2024 PELA: Learning Parameter-Efficient Models with Low-Rank Approximation CVPR 2024 PeLK: Parameter-efficient Large Kernel ConvNets with Peripheral Convolution CVPR 2024 Personalized Residuals for Concept-Driven Text-to-Image Generation CVPR 2024 Pick-or-Mix: Dynamic Channel Sampling for ConvNets CVPR 2024 PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networks CVPR 2024