Model Compression

Towards Efficient 3D Object Detection with Knowledge Distillation NeurIPS 2022 Towards Efficient NLP: A Standard Evaluation and A Strong Baseline NAACL 2022 Towards Fully Sparse Training: Information Restoration with Spatial Similarity AAAI 2022 TREC: Transient Redundancy Elimination-based Convolution NeurIPS 2022 Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network EMNLP 2022 UDC: Unified DNAS for Compressible TinyML Models for Neural Processing Units NeurIPS 2022 Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders EMNLP 2022 Universality of Winning Tickets: A Renormalization Group Perspective ICML 2022 Using Deep Mixture-of-Experts to Detect Word Meaning Shift for TempoWiC EMNLP 2022 VTC-LFC: Vision Transformer Compression with Low-Frequency Components NeurIPS 2022 Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation CVPR 2022 When To Prune? A Policy Towards Early Structural Pruning CVPR 2022 Who Says Elephants Can’t Run: Bringing Large Scale MoE Models into Cloud Scale Production EMNLP 2022 Winning the Lottery Ahead of Time: Efficient Early Network Pruning ICML 2022 XDoc: Unified Pre-training for Cross-Format Document Understanding EMNLP 2022 XPrompt: Exploring the Extreme of Prompt Tuning EMNLP 2022 Zero-Shot Dynamic Quantization for Transformer Inference EMNLP 2022 Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework ICML 2021 Accelerating Neural Machine Translation with Partial Word Embedding Compression AAAI 2021 Accurate Post Training Quantization With Small Calibration Sets ICML 2021 Achieving On-Mobile Real-Time Super-Resolution With Neural Architecture and Pruning Search ICCV 2021 A Compression-Compilation Co-Design Framework Towards Real-Time Object Detection on Mobile Devices AAAI 2021 AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognition ICCV 2021 Adversarially Adaptive Normalization for Single Domain Generalization CVPR 2021 Adversarial Neuron Pruning Purifies Backdoored Deep Models NeurIPS 2021