← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Radial and Directional Posteriors for Bayesian Deep Learning AAAI 2020
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices ACL 2020
XtremeDistil: Multi-stage Distillation for Massive Multilingual Models ACL 2020
schuBERT: Optimizing Elements of BERT ACL 2020
Adaptive Compression of Word Embeddings ACL 2020
DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering ACL 2020
HAT: Hardware-Aware Transformers for Efficient Natural Language Processing ACL 2020
Distilling Neural Networks for Greener and Faster Dependency Parsing ACL 2020
Compressing Neural Machine Translation Models with 4-bit Precision ACL 2020
The NiuTrans System for WNGT 2020 Efficiency Task ACL 2020
Improved Knowledge Distillation via Teacher Assistant AAAI 2020
Layerwise Sparse Coding for Pruned Deep Neural Networks with Extreme Compression Ratio AAAI 2020
RTN: Reparameterized Ternary Network AAAI 2020
Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT ACL 2020
Adversarially Robust Distillation AAAI 2020
Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning ACL 2020
Training Decision Trees as Replacement for Convolution Layers AAAI 2020
On the Discrepancy between the Theoretical Analysis and Practical Implementations of Compressed Communication for Distributed Deep Learning AAAI 2020
Distilling Portable Generative Adversarial Networks for Image Translation AAAI 2020
Information-Theoretic Understanding of Population Risk Improvement with Model Compression AAAI 2020
DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference ACL 2020
FastBERT: a Self-distilling BERT with Adaptive Inference Time ACL 2020
ViP: Virtual Pooling for Accelerating CNN-based Image Classification and Object Detection WACV 2020
ADNet: Adaptively Dense Convolutional Neural Networks WACV 2020
Regularize, Expand and Compress: NonExpansive Continual Learning WACV 2020