model compression

Minimal Distillation Schedule for Extreme Language Model Compression EACL 2024 Mixed-Precision Quantization for Federated Learning on Resource-Constrained Heterogeneous Devices CVPR 2024 Mixture-of-Modules: Reinventing Transformers as Dynamic Assemblies of Modules EMNLP 2024 Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models NeurIPS 2024 Mixture-of-Subspaces in Low-Rank Adaptation EMNLP 2024 Mixture of Weak and Strong Experts on Graphs ICLR 2024 MobileQuant: Mobile-friendly Quantization for On-device Language Models EMNLP 2024 MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech ACL 2024 MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AAAI 2024 MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts COLING 2024 MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning EMNLP 2024 MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition EMNLP 2024 MoE Jetpack: From Dense Checkpoints to Adaptive Mixture of Experts for Vision Tasks NeurIPS 2024 MoPE-CLIP: Structured Pruning for Efficient Vision-Language Models with Module-wise Pruning Error Metric CVPR 2024 MTA4DPR: Multi-Teaching-Assistants Based Iterative Knowledge Distillation for Dense Passage Retrieval EMNLP 2024 MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation NAACL 2024 Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization NeurIPS 2024 Multilingual Brain Surgeon: Large Language Models Can Be Compressed Leaving No Language behind COLING 2024 Multistep Distillation of Diffusion Models via Moment Matching NeurIPS 2024 NACL: A General and Effective KV Cache Eviction Framework for LLM at Inference Time ACL 2024 NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation CVPR 2024 NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models ACL 2024 NeurRev: Train Better Sparse Neural Network Practically via Neuron Revitalization ICLR 2024 NOLA: Compressing LoRA using Linear Combination of Random Basis ICLR 2024 Normalized Narrow Jump To Conclusions: Normalized Narrow Shortcuts for Parameter Efficient Early Exit Transformer Prediction EMNLP 2024