← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient NIPS 2022
Weighted Distillation with Unlabeled Examples NIPS 2022
Reversible Vision Transformers CVPR 2022
Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems EMNLP 2022
Towards Fully Sparse Training: Information Restoration with Spatial Similarity AAAI 2022
Discovering and Overcoming Limitations of Noise-engineered Data-free Knowledge Distillation NIPS 2022
DyRep: Bootstrapping Training With Dynamic Re-Parameterization CVPR 2022
MiniViT: Compressing Vision Transformers With Weight Multiplexing CVPR 2022
Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning CVPR 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing EMNLP 2022
"Lossless" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach NIPS 2022
Controlled Sparsity via Constrained Optimization or: How I Learned to Stop Tuning Penalties and Love Constraints NIPS 2022
AdapLeR: Speeding up Inference by Adaptive Length Reduction ACL 2022
Multi-Granularity Structural Knowledge Distillation for Language Model Compression ACL 2022
bert2BERT: Towards Reusable Pretrained Language Models ACL 2022
Token Dropping for Efficient BERT Pretraining ACL 2022
Transkimmer: Transformer Learns to Layer-wise Skim ACL 2022
SkipBERT: Efficient Inference with Shallow Layer Skipping ACL 2022
XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding ACL 2022
TextPruner: A Model Pruning Toolkit for Pre-Trained Language Models ACL 2022
BMInf: An Efficient Toolkit for Big Model Inference and Tuning ACL 2022
Decoupled Knowledge Distillation CVPR 2022
Patch Slimming for Efficient Vision Transformers CVPR 2022
Robust Binary Models by Pruning Randomly-initialized Networks NIPS 2022
Compressible-composable NeRF via Rank-residual Decomposition NIPS 2022