Model Compression

Rethinking Knowledge Distillation With Raw Features for Semantic Segmentation WACV 2024 Rethinking Momentum Knowledge Distillation in Online Continual Learning ICML 2024 Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization EMNLP 2024 Retraining-Free Model Quantization via One-Shot Weight-Coupling Learning CVPR 2024 Revisiting the Information Capacity of Neural Network Watermarks: Upper Bound Estimation and Beyond AAAI 2024 Revisit the Essence of Distilling Knowledge through Calibration ICML 2024 RevMUX: Data Multiplexing with Reversible Adapters for Efficient LLM Batch Inference EMNLP 2024 Reweighted Solutions for Weighted Low Rank Approximation ICML 2024 RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions COLING 2024 RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization EMNLP 2024 RRADistill: Distilling LLMs’ Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Engine EMNLP 2024 S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity NeurIPS 2024 S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning NeurIPS 2024 Safe and Robust Watermark Injection with a Single OoD Image ICLR 2024 Safe LoRA: The Silver Lining of Reducing Safety Risks when Finetuning Large Language Models NeurIPS 2024 SAM-PARSER: Fine-Tuning SAM Efficiently by Parameter Space Reconstruction AAAI 2024 ScaleLLM: A Resource-Frugal LLM Serving Framework by Optimizing End-to-End Efficiency EMNLP 2024 SCA: Selective Compression Attention for Efficiently Extending the Context Window of Large Language Models EMNLP 2024 SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training NeurIPS 2024 Search for Efficient Large Language Models NeurIPS 2024 SecCoder: Towards Generalizable and Robust Secure Code Generation EMNLP 2024 Secure Your Model: An Effective Key Prompt Protection Mechanism for Large Language Models NAACL 2024 Seeing the Forest through the Trees: Data Leakage from Partial Transformer Gradients EMNLP 2024 SEER: Backdoor Detection for Vision-Language Models through Searching Target Text and Image Trigger Jointly AAAI 2024 SequentialAttention++ for Block Sparsification: Differentiable Pruning Meets Combinatorial Optimization NeurIPS 2024