← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation INTERSPEECH 2022
Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition INTERSPEECH 2022
Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer INTERSPEECH 2022
From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression AAAI 2022
MoEfication: Transformer Feed-forward Layers are Mixtures of Experts ACL 2022
DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization ACL 2022
COST-EFF: Collaborative Optimization of Spatial and Temporal Efficiency with Slenderized Multi-exit Language Models EMNLP 2022
Distilling Multilingual Transformers into CNNs for Scalable Intent Classification EMNLP 2022
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters EMNLP 2022
AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models EMNLP 2022
What Do Compressed Multilingual Machine Translation Models Forget? EMNLP 2022
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection EMNLP 2022
RedApt: An Adaptor for wav2vec 2 EncodingFaster and Smaller Speech Translation without Quality Compromise EMNLP 2022
Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network EMNLP 2022
Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT EMNLP 2022
Searching the Deployable Convolution Neural Networks for GPUs CVPR 2022
DiSparse: Disentangled Sparsification for Multitask Model Compression CVPR 2022
Implicit Feature Decoupling With Depthwise Quantization CVPR 2022
HODEC: Towards Efficient High-Order DEcomposed Convolutional Neural Networks CVPR 2022
Rep-Net: Efficient On-Device Learning via Feature Reprogramming CVPR 2022
Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation CVPR 2022
Proto2Proto: Can You Recognize the Car, the Way I Do? CVPR 2022
BigDL 2.0: Seamless Scaling of AI Pipelines From Laptops to Distributed Cluster CVPR 2022
Instance-Aware Dynamic Neural Network Quantization CVPR 2022
When To Prune? A Policy Towards Early Structural Pruning CVPR 2022