model compression

Pruning Foundation Models for High Accuracy without Retraining EMNLP 2024 Pruning From Scratch via Shared Pruning Module and Nuclear Norm-Based Regularization WACV 2024 Pruning Large Language Models to Intra-module Low-rank Architecture with Transitional Activations ACL 2024 Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging EMNLP 2024 PTMQ: Post-training Multi-Bit Quantization of Neural Networks AAAI 2024 PTQ4DiT: Post-training Quantization for Diffusion Transformers NeurIPS 2024 PTQ4SAM: Post-Training Quantization for Segment Anything CVPR 2024 Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning ICLR 2024 PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression NeurIPS 2024 PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference ACL 2024 QBB: Quantization with Binary Bases for LLMs NeurIPS 2024 QEFT: Quantization for Efficient Fine-Tuning of LLMs EMNLP 2024 QGAN: Low Footprint Quaternion Neural Vocoder for Speech Synthesis Interspeech 2024 QTIP: Quantization with Trellises and Incoherence Processing NeurIPS 2024 QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation NeurIPS 2024 QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs NeurIPS 2024 QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024 Q-VLM: Post-training Quantization for Large Vision-Language Models NeurIPS 2024 Reasons and Solutions for the Decline in Model Performance after Editing NeurIPS 2024 Reducing hallucination in structured outputs via Retrieval-Augmented Generation NAACL 2024 Reducing the Side-Effects of Oscillations in Training of Quantized YOLO Networks WACV 2024 Reg-PTQ: Regression-specialized Post-training Quantization for Fully Quantized Object Detector CVPR 2024 Reinforced Cross-Domain Knowledge Distillation on Time Series Data NeurIPS 2024 Reinforcement Learning as a Parsimonious Alternative to Prediction Cascades: A Case Study on Image Segmentation AAAI 2024 ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models ICLR 2024