Model Compression

PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference ACL 2024 QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning EMNLP 2024 QEFT: Quantization for Efficient Fine-Tuning of LLMs EMNLP 2024 QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models ICLR 2024 QTIP: Quantization with Trellises and Incoherence Processing NeurIPS 2024 QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024 Real-Time User-Guided Adaptive Colorization With Vision Transformer WACV 2024 Reasons and Solutions for the Decline in Model Performance after Editing NeurIPS 2024 Reducing Spatial Fitting Error in Distillation of Denoising Diffusion Models AAAI 2024 Reducing the Side-Effects of Oscillations in Training of Quantized YOLO Networks WACV 2024 Representation Noising: A Defence Mechanism Against Harmful Finetuning NeurIPS 2024 REPrune: Channel Pruning via Kernel Representative Selection AAAI 2024 Resource Efficient Deep Learning Hardware Watermarks with Signature Alignment AAAI 2024 Resource-Efficient Transformer Pruning for Finetuning of Large Models CVPR 2024 Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs ACL 2024 Rethinking Imbalance in Image Super-Resolution for Efficient Inference NeurIPS 2024 Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization EMNLP 2024 Revisiting Neural Networks for Continual Learning: An Architectural Perspective IJCAI 2024 RMT: Retentive Networks Meet Vision Transformers CVPR 2024 Robustness-Guided Image Synthesis for Data-Free Quantization AAAI 2024 RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization EMNLP 2024 RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning EMNLP 2024 RRADistill: Distilling LLMs’ Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Engine EMNLP 2024 S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity NeurIPS 2024 Safe LoRA: The Silver Lining of Reducing Safety Risks when Finetuning Large Language Models NeurIPS 2024