← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

On the Predictability of Pruning Across Scales ICML 2021
Dirichlet Pruning for Convolutional Neural Networks AISTATS 2021
A Probabilistic Approach to Neural Network Pruning ICML 2021
Federated Learning with Sparsification-Amplified Privacy and Adaptive Optimization IJCAI 2021
Teacher Guided Neural Architecture Search for Face Recognition AAAI 2021
CAKES: Channel-wise Automatic KErnel Shrinking for Efficient 3D Networks AAAI 2021
Distribution Adaptive INT8 Quantization for Training CNNs AAAI 2021
Linearly Replaceable Filters for Deep Network Channel Pruning AAAI 2021
Deeplite NeutrinoTM: A BlackBox Framework for Constrained Deep Learning Model Optimization AAAI 2021
Understanding and Overcoming the Challenges of Efficient Transformer Quantization EMNLP 2021
AUTOSUMM: Automatic Model Creation for Text Summarization EMNLP 2021
Isotonic Data Augmentation for Knowledge Distillation IJCAI 2021
Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation IJCAI 2021
Dense for the Price of Sparse: Improved Performance of Sparsely Initialized Networks via a Subspace Offset ICML 2021
Constrained differentially private federated learning for low-bandwidth devices UAI 2021
Not all parameters are born equal: Attention is mostly what you need EMNLP 2021
Limitations of Knowledge Distillation for Zero-shot Transfer Learning EMNLP 2021
Memory-efficient Transformers via Top-k Attention EMNLP 2021
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021
Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching AAAI 2021
A Compression-Compilation Co-Design Framework Towards Real-Time Object Detection on Mobile Devices AAAI 2021
Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021
Findings of the WMT 2021 Shared Task on Efficient Translation EMNLP 2021
Pruning Neural Machine Translation for Speed Using Group Lasso EMNLP 2021
On Attention Redundancy: A Comprehensive Study NAACL 2021