Model Compression

Leveraging Inter-Layer Dependency for Post -Training Quantization NeurIPS 2022 Linearizing Transformer with Key-Value Memory EMNLP 2022 Lite-MDETR: A Lightweight Multi-Modal Detector CVPR 2022 Lite Pose: Efficient Architecture Design for 2D Human Pose Estimation CVPR 2022 Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks NeurIPS 2022 Low-bit Shift Network for End-to-End Spoken Language Understanding Interspeech 2022 Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations NeurIPS 2022 Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach NeurIPS 2022 MemSR: Training Memory-efficient Lightweight Model for Image Super-Resolution ICML 2022 MISRNet: Lightweight Neural Vocoder Using Multi-Input Single Shared Residual Blocks Interspeech 2022 Mixture of Attention Heads: Selecting Attention Heads Per Token EMNLP 2022 Model Cascading: Towards Jointly Improving Efficiency and Accuracy of NLP Systems EMNLP 2022 Modular and Parameter-Efficient Fine-Tuning for NLP Models EMNLP 2022 MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation NAACL 2022 MoEfication: Transformer Feed-forward Layers are Mixtures of Experts ACL 2022 MONICA2: Mobile Neural Voice Command Assistants towards Smaller and Smarter AAAI 2022 Mr.BiQ: Post-Training Non-Uniform Quantization Based on Minimizing the Reconstruction Error CVPR 2022 Multi-Granularity Structural Knowledge Distillation for Language Model Compression ACL 2022 Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation CVPR 2022 Not All Bits have Equal Value: Heterogeneous Precisions via Trainable Noise NeurIPS 2022 On-Device Training Under 256KB Memory NeurIPS 2022 One-shot Neural Backdoor Erasing via Adversarial Weight Masking NeurIPS 2022 Online Convolutional Re-Parameterization CVPR 2022 Online Hybrid Lightweight Representations Learning: Its Application to Visual Tracking IJCAI 2022 On Lottery Tickets and Minimal Task Representations in Deep Reinforcement Learning ICLR 2022