Model Compression

Knowledge Distillation via Constrained Variational Inference AAAI 2022 Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer Interspeech 2022 Language model compression with weighted low-rank factorization ICLR 2022 LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency COLING 2022 Learning Best Combination for Efficient N:M Sparsity NeurIPS 2022 Learning Disentangled Representation in Pruning for Real-Time UAV Tracking ACML 2022 Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, And No Retraining ICLR 2022 Learn to Reverse DNNs from AI Programs Automatically IJCAI 2022 Leveraging Inter-Layer Dependency for Post -Training Quantization NeurIPS 2022 Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations NeurIPS 2022 Low-Resource Adaptation of Open-Domain Generative Chatbots ACL 2022 LPC: A Logits and Parameter Calibration Framework for Continual Learning EMNLP 2022 MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fields NeurIPS 2022 Making Parameter-efficient Tuning More Efficient: A Unified Framework for Classification Tasks COLING 2022 Masking Adversarial Damage: Finding Adversarial Saliency for Robust and Sparse Network CVPR 2022 Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token EMNLP 2022 MIA-Former: Efficient and Robust Vision Transformers via Multi-Grained Input-Adaptation AAAI 2022 Model Compression Using Optimal Transport WACV 2022 Model Preserving Compression for Neural Networks NeurIPS 2022 Modular and Parameter-Efficient Fine-Tuning for NLP Models EMNLP 2022 Monarch: Expressive Structured Matrices for Efficient and Accurate Training ICML 2022 Multicoated Supermasks Enhance Hidden Networks ICML 2022 NAS-VAD: Neural Architecture Search for Voice Activity Detection Interspeech 2022 Neural Network Approximation based on Hausdorff distance of Tropical Zonotopes ICLR 2022 Neural Network Pruning by Cooperative Coevolution IJCAI 2022