← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023
Efficient Skeleton-Based Action Recognition via Joint-Mapping Strategies WACV 2023
A Multiple-Teacher Pruning Based Self-Distillation (MT-PSD) Approach to Model Compression for Audio-Visual Wake Word Spotting INTERSPEECH 2023
LightClone: Speaker-guided Parallel Subnet Selection for Few-shot Voice Cloning INTERSPEECH 2023
Adaptive Neural Network Quantization For Lightweight Speaker Verification INTERSPEECH 2023
Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ACL 2023
GlobalFlowNet: Video Stabilization Using Deep Distilled Global Motion Estimates WACV 2023
FeatER: An Efficient Network for Human Reconstruction via Feature Map-Based TransformER CVPR 2023
Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding EACL 2023
Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference ACL 2023
FaLA: Fast Linear Adaptation for Replacing Backbone Models on Edge Devices EMNLP 2023
Sharing Encoder Representations across Languages, Domains and Tasks in Large-Scale Spoken Language Understanding ACL 2023
LECO: Improving Early Exiting via Learned Exits and Comparison-based Exiting Mechanism ACL 2023
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training ACL 2023
Teaching Small Language Models to Reason ACL 2023
Adaptive Contrastive Knowledge Distillation for BERT Compression ACL 2023
Boost Transformer-based Language Models with GPU-Friendly Sparsity and Quantization ACL 2023
CocaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval ACL 2023
Dual Relation Knowledge Distillation for Object Detection IJCAI 2023
YOLO-ReT: Towards High Accuracy Real-Time Object Detection on Edge GPUs WACV 2022
Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selection ACL 2022
Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models COLING 2022
Token and Head Adaptive Transformers for Efficient Natural Language Processing COLING 2022
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher COLING 2022
To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding IJCAI 2022