model compression

JANUS: Joint Autoregressive and Non-autoregressive Training with Auxiliary Loss for Sequence Generation EMNLP 2022 Killing Two Birds With One Stone: Efficient and Robust Training of Face Recognition CNNs by Partial FC CVPR 2022 Knowledge Distillation: A Good Teacher Is Patient and Consistent CVPR 2022 Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability CVPR 2022 Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning Interspeech 2022 Knowledge distillation for In-memory keyword spotting model Interspeech 2022 Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-Guided Feature Imitation AAAI 2022 Knowledge Distillation from A Stronger Teacher NeurIPS 2022 Knowledge Distillation Meets Few-Shot Learning: An Approach for Few-Shot Intent Classification Within and Across Domains ACL 2022 Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022 Knowledge Distillation via Constrained Variational Inference AAAI 2022 Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer Interspeech 2022 Knowledge Distillation via the Target-Aware Transformer CVPR 2022 Knowledge Distillation with Reptile Meta-Learning for Pretrained Language Model Compression COLING 2022 Knowledge Distillation With the Reused Teacher Classifier CVPR 2022 Knowledge Inheritance for Pre-trained Language Models NAACL 2022 Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition Interspeech 2022 KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation NAACL 2022 Kronecker Decomposition for GPT Compression ACL 2022 Language model compression with weighted low-rank factorization ICLR 2022 LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency COLING 2022 Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training NeurIPS 2022 Leaner and Faster: Two-Stage Model Compression for Lightweight Text-Image Retrieval NAACL 2022 Learnable Lookup Table for Neural Network Quantization CVPR 2022 Learning Best Combination for Efficient N:M Sparsity NeurIPS 2022