Model Compression

A Deep Learning-Based Face Mask Detector for Autonomous Nano-Drones (Student Abstract) AAAI 2022 Advancing Model Pruning via Bi-level Optimization NeurIPS 2022 Aligned Weight Regularizers for Pruning Pretrained Neural Networks ACL 2022 AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models EMNLP 2022 An Effective Post-training Embedding Binarization Approach for Fast Online Top-K Passage Matching AACL 2022 A Novel Differentiable Mixed-Precision Quantization Search Framework for Alleviating the Matthew Effect and Improving Robustness ACML 2022 A Passive Similarity based CNN Filter Pruning for Efficient Acoustic Scene Classification Interspeech 2022 Are You Stealing My Model? Sample Correlation for Fingerprinting Deep Neural Networks NeurIPS 2022 Attention Temperature Matters in Abstractive Summarization Distillation ACL 2022 Attentive Fine-Grained Structured Sparsity for Image Restoration CVPR 2022 Audio Lottery: Speech Recognition Made Ultra-Lightweight, Noise-Robust, and Transferable ICLR 2022 A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models NeurIPS 2022 Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropagation NeurIPS 2022 Be Like Water: Adaptive Floating Point for Machine Learning ICML 2022 bert2BERT: Towards Reusable Pretrained Language Models ACL 2022 BiBERT: Accurate Fully Binarized BERT ICLR 2022 BiMLP: Compact Binary Architectures for Vision Multi-Layer Perceptrons NeurIPS 2022 Binary Early-Exit Network for Adaptive Inference on Low-Resource Devices Interspeech 2022 BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models ACL 2022 BiT: Robustly Binarized Multi-distilled Transformer NeurIPS 2022 Bitwidth Heterogeneous Federated Learning with Progressive Weight Dequantization ICML 2022 BMCook: A Task-agnostic Compression Toolkit for Big Models EMNLP 2022 BMInf: An Efficient Toolkit for Big Model Inference and Tuning ACL 2022 Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks COLING 2022 Composable Sparse Fine-Tuning for Cross-Lingual Transfer ACL 2022