Model Compression

Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning NeurIPS 2022 Optimal channel selection with discrete QCQP AISTATS 2022 Optimal Clipping and Magnitude-aware Differentiation for Improved Quantization-aware Training ICML 2022 Overcoming Oscillations in Quantization-Aware Training ICML 2022 PAC-Net: A Model Pruning Approach to Inductive Transfer Learning ICML 2022 Parameter-Efficient Abstractive Question Answering over Tables or Text ACL 2022 Parameter-Efficient Legal Domain Adaptation EMNLP 2022 Parameter-Efficient Masking Networks NeurIPS 2022 Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models COLING 2022 Partially-Random Initialization: A Smoking Gun for Binarization Hypothesis of BERT EMNLP 2022 PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Models CVPR 2022 PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance ICML 2022 Playing Lottery Tickets with Vision and Language AAAI 2022 POET: Training Neural Networks on Tiny Devices with Integrated Rematerialization and Paging ICML 2022 Prior Gradient Mask Guided Pruning-Aware Fine-Tuning AAAI 2022 PrivateSNN: Privacy-Preserving Spiking Neural Networks AAAI 2022 Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency ACL 2022 projUNN: efficient method for training deep networks with unitary matrices NeurIPS 2022 Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher COLING 2022 Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models EMNLP 2022 Prune and Tune Ensembles: Low-Cost Ensemble Learning with Sparse Independent Subnetworks AAAI 2022 Pruning-as-Search: Efficient Neural Architecture Search via Channel Pruning and Structural Reparameterization IJCAI 2022 Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions NeurIPS 2022 Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selection ACL 2022 QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization ICLR 2022