Model Compression

FracBits: Mixed Precision Quantization via Fractional Bit-Widths AAAI 2021 FRILL: A Non-Semantic Speech Embedding for Mobile Devices Interspeech 2021 Frivolous Units: Wider Networks Are Not Really That Wide AAAI 2021 GAML-BERT: Improving BERT Early Exiting by Gradient Aligned Mutual Learning EMNLP 2021 General Instance Distillation for Object Detection CVPR 2021 GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddings ICML 2021 HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search ICML 2021 Harmonized Dense Knowledge Distillation Training for Multi-Exit Architectures AAAI 2021 HAWQ-V3: Dyadic Neural Network Quantization ICML 2021 How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021 HW-TSC’s Participation in the WMT 2021 Efficiency Shared Task EMNLP 2021 Improving Accuracy of Binary Neural Networks Using Unbalanced Activation Distribution CVPR 2021 Improving KernelSHAP: Practical Shapley Value Estimation Using Linear Regression AISTATS 2021 Improving the Performance-Compatibility Tradeoff with Personalized Objective Functions (Student Abstract) AAAI 2021 Instance-Conditional Knowledge Distillation for Object Detection NeurIPS 2021 Interpretable Embedding Procedure Knowledge Transfer via Stacked Principal Component Analysis and Graph Neural Network AAAI 2021 Isotonic Data Augmentation for Knowledge Distillation IJCAI 2021 Joint-DetNAS: Upgrade Your Detector With NAS, Pruning and Dynamic Distillation CVPR 2021 Knowledge Distillation for Singing Voice Detection Interspeech 2021 Layer-Wise Neural Network Compression via Layer Fusion ACML 2021 Learnable Companding Quantization for Accurate Low-Bit Neural Networks CVPR 2021 Learning a Neural Diff for Speech Models Interspeech 2021 Learning Compact Metrics for MT EMNLP 2021 Learning Frequency Domain Approximation for Binary Neural Networks NeurIPS 2021 Learning Light-Weight Translation Models from Deep Transformer AAAI 2021