conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Distribution Adaptive INT8 Quantization for Training CNNs AAAI 2021
Linearly Replaceable Filters for Deep Network Channel Pruning AAAI 2021
Deeplite NeutrinoTM: A BlackBox Framework for Constrained Deep Learning Model Optimization AAAI 2021
Understanding and Overcoming the Challenges of Efficient Transformer Quantization EMNLP 2021
AUTOSUMM: Automatic Model Creation for Text Summarization EMNLP 2021
Isotonic Data Augmentation for Knowledge Distillation IJCAI 2021
Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation IJCAI 2021
Dense for the Price of Sparse: Improved Performance of Sparsely Initialized Networks via a Subspace Offset ICML 2021
Constrained differentially private federated learning for low-bandwidth devices UAI 2021
Not all parameters are born equal: Attention is mostly what you need EMNLP 2021
Limitations of Knowledge Distillation for Zero-shot Transfer Learning EMNLP 2021
Memory-efficient Transformers via Top-k Attention EMNLP 2021
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021
Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching AAAI 2021
A Compression-Compilation Co-Design Framework Towards Real-Time Object Detection on Mobile Devices AAAI 2021
Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021
Findings of the WMT 2021 Shared Task on Efficient Translation EMNLP 2021
Pruning Neural Machine Translation for Speed Using Group Lasso EMNLP 2021
On Attention Redundancy: A Comprehensive Study NAACL 2021
Learning to Augment for Data-scarce Domain BERT Knowledge Distillation AAAI 2021
Faster Depth-Adaptive Transformers AAAI 2021
Continual Learning for Named Entity Recognition AAAI 2021
Accelerating Neural Machine Translation with Partial Word Embedding Compression AAAI 2021
Knowledge Distillation with Noisy Labels for Natural Language Understanding EMNLP 2021
Towards Compact CNNs via Collaborative Compression CVPR 2021