Model Compression

Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selection ACL 2022 QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization ICLR 2022 Quadapter: Adapter for GPT-2 Quantization EMNLP 2022 Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Free CVPR 2022 Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm NeurIPS 2022 Redistribution of Weights and Activations for AdderNet Quantization NeurIPS 2022 Reducing uncertainty at the score-to-LR stage in likelihood ratio-based forensic voice comparison using automatic speaker recognition systems Interspeech 2022 Reliable Adversarial Distillation with Unreliable Teachers ICLR 2022 ResectNet: An Efficient Architecture for Voice Activity Detection on Mobile Devices Interspeech 2022 ReservoirComputing.jl: An Efficient and Modular Library for Reservoir Computing Models JMLR 2022 Revisiting Parameter-Efficient Tuning: Are We Really There Yet? EMNLP 2022 Revisiting Random Channel Pruning for Neural Network Compression CVPR 2022 Revisit Kernel Pruning with Lottery Regulated Grouped Convolutions ICLR 2022 Robust Binary Models by Pruning Randomly-initialized Networks NeurIPS 2022 Robust Lottery Tickets for Pre-trained Language Models ACL 2022 Scaling Language Model Size in Cross-Device Federated Learning ACL 2022 SDQ: Stochastic Differentiable Quantization with Mixed Precision ICML 2022 Self-Distillation Based on High-level Information Supervision for Compressing End-to-End ASR Model Interspeech 2022 Signing the Supermask: Keep, Hide, Invert ICLR 2022 Slimmable Domain Adaptation CVPR 2022 SOSP: Efficiently Capturing Global Correlations by Second-Order Structured Pruning ICLR 2022 SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters EMNLP 2022 Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm ACL 2022 SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute OSDI 2022 Spartan: Differentiable Sparsity via Regularized Transportation NeurIPS 2022