Model Compression

MERGE: Fast Private Text Generation AAAI 2024 MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic EMNLP 2024 MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning EMNLP 2024 Mini but Mighty: Finetuning ViTs With Mini Adapters WACV 2024 MiniCache: KV Cache Compression in Depth Dimension for Large Language Models NeurIPS 2024 MiniLLM: Knowledge Distillation of Large Language Models ICLR 2024 Minimal Distillation Schedule for Extreme Language Model Compression EACL 2024 Mitigating the Language Mismatch and Repetition Issues in LLM-based Machine Translation via Model Editing EMNLP 2024 Mixture of LoRA Experts ICLR 2024 Mixture-of-Modules: Reinventing Transformers as Dynamic Assemblies of Modules EMNLP 2024 Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models NeurIPS 2024 MobileQuant: Mobile-friendly Quantization for On-device Language Models EMNLP 2024 Model Merging by Uncertainty-Based Gradient Matching ICLR 2024 Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs ICLR 2024 MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition EMNLP 2024 MoPE-CLIP: Structured Pruning for Efficient Vision-Language Models with Module-wise Pruning Error Metric CVPR 2024 MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning CVPR 2024 Multilingual Brain Surgeon: Large Language Models Can Be Compressed Leaving No Language behind COLING 2024 Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection Interspeech 2024 Network Memory Footprint Compression Through Jointly Learnable Codebooks and Mappings ICLR 2024 Neural Video Compression with Feature Modulation CVPR 2024 NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models ACL 2024 Nickel and Diming Your GAN: A Dual-Method Approach to Enhancing GAN Efficiency via Knowledge Distillation ECCV 2024 NN-Defined Modulator: Reconfigurable and Portable Software Modulator on IoT Gateways NSDI 2024 No Free Prune: Information-Theoretic Barriers to Pruning at Initialization ICML 2024