Model Compression

Forget-free Continual Learning with Winning Subnetworks ICML 2022 Forward Compatible Few-Shot Class-Incremental Learning CVPR 2022 FP8 Quantization: The Power of the Exponent NeurIPS 2022 From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression AAAI 2022 FT-DeepNets: Fault-Tolerant Convolutional Neural Networks With Kernel-Based Duplication WACV 2022 Functional Ensemble Distillation NeurIPS 2022 Gender Biases and Where to Find Them: Exploring Gender Bias in Pre-Trained Transformer-based Language Models Using Movement Pruning NAACL 2022 Get More at Once: Alternating Sparse Training with Gradient Correction NeurIPS 2022 GPT3.int8(): 8-bit Matrix Multiplication for Transformers at Scale NeurIPS 2022 Gradient Step Denoiser for convergent Plug-and-Play ICLR 2022 Hard Gate Knowledge Distillation - Leverage Calibration for Robust and Reliable Language Model EMNLP 2022 HashFormers: Towards Vocabulary-independent Pre-trained Transformers EMNLP 2022 HODEC: Towards Efficient High-Order DEcomposed Convolutional Neural Networks CVPR 2022 HW-TSC’s Submission for the WMT22 Efficiency Task EMNLP 2022 HyperDomainNet: Universal Domain Adaptation for Generative Adversarial Networks NeurIPS 2022 Hypoformer: Hybrid Decomposition Transformer for Edge-friendly Neural Machine Translation EMNLP 2022 Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection EMNLP 2022 Information-Theoretic GAN Compression with Variational Energy-based Model NeurIPS 2022 Instance-Aware Dynamic Neural Network Quantization CVPR 2022 IntraQ: Learning Synthetic Images With Intra-Class Heterogeneity for Zero-Shot Network Quantization CVPR 2022 Intriguing Properties of Compression on Multilingual Models EMNLP 2022 Isolation Mechanisms for High-Speed Packet-Processing Pipelines NSDI 2022 i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery L4DC 2022 It's All in the Teacher: Zero-Shot Quantization Brought Closer to the Teacher CVPR 2022 Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022