Model Compression

Who Says Elephants Can’t Run: Bringing Large Scale MoE Models into Cloud Scale Production EMNLP 2022 XPrompt: Exploring the Extreme of Prompt Tuning EMNLP 2022 Zero-Shot Dynamic Quantization for Transformer Inference EMNLP 2022 4-Bit Quantization of LSTM-Based Speech Recognition Models Interspeech 2021 A Block Minifloat Representation for Training Deep Neural Networks ICLR 2021 Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework ICML 2021 Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Masks NeurIPS 2021 Accelerating BERT Inference for Sequence Labeling via Early-Exit ACL 2021 Accelerating Neural Machine Translation with Partial Word Embedding Compression AAAI 2021 Accurate Post Training Quantization With Small Calibration Sets ICML 2021 AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networks NeurIPS 2021 AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decoding ACL 2021 Adversarial Neuron Pruning Purifies Backdoored Deep Models NeurIPS 2021 A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration ICML 2021 Against Membership Inference Attack: Pruning is All You Need IJCAI 2021 Aligned Structured Sparsity Learning for Efficient Image Super-Resolution NeurIPS 2021 Amortized Neural Networks for Low-Latency Speech Recognition Interspeech 2021 An Efficient Transformer Decoder with Compressed Sub-layers AAAI 2021 Annealing Knowledge Distillation EACL 2021 An Overview of Uncertainty Calibration for Text Classification and the Role of Distillation ACL 2021 Arabic Compact Language Modelling for Resource Limited Devices EACL 2021 A Unified Lottery Ticket Hypothesis for Graph Neural Networks ICML 2021 Auto Graph Encoder-Decoder for Neural Network Pruning ICCV 2021 Automatic Mixed-Precision Quantization Search of BERT IJCAI 2021 AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models ACL 2021