Model Compression

Lightweight Image Super-Resolution via Flexible Meta Pruning ICML 2024 Lightweight Transducer Based on Frame-Level Criterion Interspeech 2024 Linearly Decomposing and Recomposing Vision Transformers for Diverse-Scale Models NeurIPS 2024 LION: Implicit Vision Prompt Tuning AAAI 2024 LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning NeurIPS 2024 LitE-SNN: Designing Lightweight and Efficient Spiking Neural Network through Spatial-Temporal Compressive Network Search and Joint Optimization IJCAI 2024 LLM can Achieve Self-Regulation via Hyperparameter Aware Generation ACL 2024 LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment NeurIPS 2024 LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit EMNLP 2024 LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs IJCAI 2024 LLM in a flash: Efficient Large Language Model Inference with Limited Memory ACL 2024 LLM-QAT: Data-Free Quantization Aware Training for Large Language Models ACL 2024 LM-Cocktail: Resilient Tuning of Language Models via Model Merging ACL 2024 Localizing Task Information for Improved Model Merging and Compression ICML 2024 LocMoE: A Low-overhead MoE for Large Language Model Training IJCAI 2024 LoNAS: Elastic Low-Rank Adapters for Efficient Large Language Models COLING 2024 Look-Up Table Compression for Efficient Image Restoration CVPR 2024 LoRAExit: Empowering Dynamic Modulation of LLMs in Resource-limited Settings using Low-rank Adapters EMNLP 2024 LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks ACL 2024 LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models EMNLP 2024 LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning ACL 2024 LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild ACL 2024 LORS: Low-rank Residual Structure for Parameter-Efficient Network Stacking CVPR 2024 Low Precision Local Training is Enough for Federated Learning NeurIPS 2024 Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach CVPR 2024