model compression

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models EMNLP 2024 Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation NeurIPS 2024 Weight-Inherited Distillation for Task-Agnostic BERT Compression NAACL 2024 What Makes a Good Prune? Maximal Unstructured Pruning for Maximal Cosine Similarity ICLR 2024 What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation AAAI 2024 When Quantization Affects Confidence of Large Language Models? NAACL 2024 White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is? JMLR 2024 Wino Vidi Vici: Conquering Numerical Instability of 8-Bit Winograd Convolution for Accurate Inference Acceleration on Edge WACV 2024 WRP: Weight Recover Prune for Structured Sparsity ACL 2024 xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics EMNLP 2024 Your Student is Better Than Expected: Adaptive Teacher-Student Collaboration for Text-Conditional Diffusion Models CVPR 2024 Zero-TPrune: Zero-Shot Token Pruning through Leveraging of the Attention Graph in Pre-Trained Transformers CVPR 2024 ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification NeurIPS 2024 $\rm A^2Q$: Aggregation-Aware Quantization for Graph Neural Networks ICLR 2023 1% VS 100%: Parameter-Efficient Low Rank Adapter for Dense Predictions CVPR 2023 2-bit Conformer quantization for automatic speech recognition Interspeech 2023 ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression Interspeech 2023 A Binary Keyword Spotting System with Error-Diffusion Based Feature Binarization Interspeech 2023 Accelerated On-Device Forward Neural Network Training with Module-Wise Descending Asynchronism NeurIPS 2023 Accelerating Dataset Distillation via Model Augmentation CVPR 2023 Accelerating Molecular Graph Neural Networks via Knowledge Distillation NeurIPS 2023 Accelerating Vision-Language Pretraining With Free Language Modeling CVPR 2023 Acceleration of Large Transformer Model Training by Sensitivity-Based Layer Dropping AAAI 2023 AccelIR: Task-Aware Image Compression for Accelerating Neural Restoration CVPR 2023 Accurate and Structured Pruning for Efficient Automatic Speech Recognition Interspeech 2023