Model Compression

EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets ACL 2021 Effective Sparsification of Neural Networks With Global Sparsity Constraint CVPR 2021 Efficient Combination of Rematerialization and Offloading for Training DNNs NeurIPS 2021 Efficient Conformer with Prob-Sparse Attention Mechanism for End-to-End Speech Recognition Interspeech 2021 Efficient Feature Transformations for Discriminative and Generative Continual Learning CVPR 2021 Efficient Lottery Ticket Finding: Less Data is More ICML 2021 Efficient Neural Network Training via Forward and Backward Propagation Sparsification NeurIPS 2021 Efficient Weight Factorization for Multilingual Speech Recognition Interspeech 2021 Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators ACL 2021 Exploring Sparsity in Image Super-Resolution for Efficient Inference CVPR 2021 Extremely Low Footprint End-to-End ASR System for Smart Device Interspeech 2021 FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search ICCV 2021 Finetuning Pretrained Transformers into RNNs EMNLP 2021 FracBits: Mixed Precision Quantization via Fractional Bit-Widths AAAI 2021 Frivolous Units: Wider Networks Are Not Really That Wide AAAI 2021 General Instance Distillation for Object Detection CVPR 2021 Goten: GPU-Outsourcing Trusted Execution of Neural Network Training AAAI 2021 Graph-Free Knowledge Distillation for Graph Neural Networks IJCAI 2021 Greedy Search Algorithm for Mixed Precision in Post-Training Quantization of Convolutional Neural Network Inspired by Submodular Optimization ACML 2021 HAWQ-V3: Dyadic Neural Network Quantization ICML 2021 HEMET: A Homomorphic-Encryption-Friendly Privacy-Preserving Mobile Neural Network Architecture ICML 2021 How to Train BERT with an Academic Budget EMNLP 2021 IA-RED$^2$: Interpretability-Aware Redundancy Reduction for Vision Transformers NeurIPS 2021 Improving Accuracy of Binary Neural Networks Using Unbalanced Activation Distribution CVPR 2021 Interpreting and Disentangling Feature Components of Various Complexity from DNNs ICML 2021