← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference NAACL 2021
Distilling Linguistic Context for Language Model Compression EMNLP 2021
Effectiveness of Arbitrary Transfer Sets for Data-Free Knowledge Distillation WACV 2021
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation ACL 2021
Slimmable Generative Adversarial Networks AAAI 2021
An Efficient Transformer Decoder with Compressed Sub-layers AAAI 2021
YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design AAAI 2021
ALP-KD: Attention-Based Layer Projection for Knowledge Distillation AAAI 2021
OPQ: Compressing Deep Neural Networks with One-shot Pruning-Quantization AAAI 2021
MeliusNet: An Improved Network Architecture for Binary Neural Networks WACV 2021
EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets ACL 2021
Parameter-Efficient Transfer Learning with Diff Pruning ACL 2021
Mirror Descent View for Neural Network Quantization AISTATS 2021
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization ACL 2021
Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators ACL 2021
BinaryBERT: Pushing the Limit of BERT Quantization ACL 2021
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation ACL 2021
Weight Distillation: Transferring the Knowledge in Neural Network Parameters ACL 2021
Holistic Filter Pruning for Efficient Deep Neural Networks WACV 2021
Automatic Mixed-Precision Quantization Search of BERT IJCAI 2021
Towards Fast and Accurate Multi-Person Pose Estimation on Mobile Devices IJCAI 2021
SA-BNN: State-Aware Binary Neural Network AAAI 2021
Low-Precision Reinforcement Learning: Running Soft Actor-Critic in Half Precision ICML 2021
DPFPS: Dynamic and Progressive Filter Pruning for Compressing Convolutional Neural Networks from Scratch AAAI 2021
Progressive Network Grafting for Few-Shot Knowledge Distillation AAAI 2021