conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Models CVPR 2022
Knowledge Distillation: A Good Teacher Is Patient and Consistent CVPR 2022
Dynamic Kernel Selection for Improved Generalization and Memory Efficiency in Meta-Learning CVPR 2022
Compressing Models With Few Samples: Mimicking Then Replacing CVPR 2022
Knowledge Distillation With the Reused Teacher Classifier CVPR 2022
Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks ICML 2022
Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation ICML 2022
Winning the Lottery Ahead of Time: Efficient Early Network Pruning ICML 2022
TSPipe: Learn from Teacher Faster with Pipelines ICML 2022
Multicoated Supermasks Enhance Hidden Networks ICML 2022
Spatial-Channel Token Distillation for Vision MLPs ICML 2022
An Effective Post-training Embedding Binarization Approach for Fast Online Top-K Passage Matching AACL 2022
Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks AACL 2022
Plug and Play Knowledge Distillation for kNN-LM with External Logits AACL 2022
Optimal channel selection with discrete QCQP AISTATS 2022
Masked Training of Neural Networks with Partial Gradients AISTATS 2022
Extractive Knowledge Distillation WACV 2022
Multi-View Attention Transfer for Efficient Speech Enhancement INTERSPEECH 2022
EPIC TTS Models: Empirical Pruning Investigations Characterizing Text-To-Speech Models INTERSPEECH 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation INTERSPEECH 2022
Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition INTERSPEECH 2022
Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer INTERSPEECH 2022
From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression AAAI 2022
MoEfication: Transformer Feed-forward Layers are Mixtures of Experts ACL 2022
DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization ACL 2022