Model Compression

SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models UAI 2023 SpENCNN: Orchestrating Encoding and Sparsity for Fast Homomorphically Encrypted Neural Network Inference ICML 2023 Stable and low-precision training for large-scale vision-language models NeurIPS 2023 STEP: Learning N:M Structured Sparsity Masks from Scratch with Precondition ICML 2023 Structured Pruning for Efficient Generative Pre-trained Language Models ACL 2023 Structured Sparsity Learning for Efficient Video Super-Resolution CVPR 2023 SUBP: Soft Uniform Block Pruning for 1×N Sparse CNNs Multithreading Acceleration NeurIPS 2023 Task-Agnostic Structured Pruning of Speech Representation Models Interspeech 2023 Task-specific Compression for Multi-task Language Models using Attribution-based Pruning EACL 2023 Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023 TexQ: Zero-shot Network Quantization with Texture Feature Distribution Calibration NeurIPS 2023 The case for 4-bit precision: k-bit Inference Scaling Laws ICML 2023 The Pick-to-Learn Algorithm: Empowering Compression for Tight Generalization Bounds and Improved Post-training Performance NeurIPS 2023 The Rank-Reduced Kalman Filter: Approximate Dynamical-Low-Rank Filtering In High Dimensions NeurIPS 2023 TinyNeRF: Towards 100 x Compression of Voxel Radiance Fields AAAI 2023 Tiny Updater: Towards Efficient Neural Network-Driven Software Updating ICCV 2023 TORE: Token Reduction for Efficient Human Mesh Recovery with Transformer ICCV 2023 Toward Accurate Post-Training Quantization for Image Super Resolution CVPR 2023 Towards A Unified View of Sparse Feed-Forward Network in Pretraining Large Language Model EMNLP 2023 Towards Efficient and Accurate Winograd Convolution via Full Quantization NeurIPS 2023 Towards Fairness-aware Adversarial Network Pruning ICCV 2023 Towards Fully Quantized Neural Networks For Speech Enhancement Interspeech 2023 Towards Robust Model Watermark via Reducing Parametric Vulnerability ICCV 2023 Towards Robust Pruning: An Adaptive Knowledge-Retention Pruning Strategy for Language Models EMNLP 2023 Trainability Preserving Neural Pruning ICLR 2023