conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Beyond the Limitation of Monocular 3D Detector via Knowledge Distillation ICCV 2023
DOT: A Distillation-Oriented Trainer ICCV 2023
Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection ICCV 2023
FerKD: Surgical Label Adaptation for Efficient Distillation ICCV 2023
Q-Diffusion: Quantizing Diffusion Models ICCV 2023
Accurate and Structured Pruning for Efficient Automatic Speech Recognition INTERSPEECH 2023
Towards Lossless Head Pruning through Automatic Peer Distillation for Language Models IJCAI 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes ACL 2023
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer ACL 2023
LightFormer: Light-weight Transformer Using SVD-based Weight Transfer and Parameter Sharing ACL 2023
POTTER: Pooling Attention Transformer for Efficient Human Mesh Recovery CVPR 2023
MARS: Masked Automatic Ranks Selection in Tensor Decompositions AISTATS 2023
Masked Autoencoders Enable Efficient Knowledge Distillers CVPR 2023
Parameter-efficient Dysarthric Speech Recognition Using Adapter Fusion and Householder Transformation INTERSPEECH 2023
Distillation Strategies for Discriminative Speech Recognition Rescoring INTERSPEECH 2023
Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions AISTATS 2023
Tensor decomposition for minimization of E2E SLU model toward on-device processing INTERSPEECH 2023
LAMASSU: A Streaming Language-Agnostic Multilingual Speech Recognition and Translation Model Using Neural Transducers INTERSPEECH 2023
You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language Model CVPR 2023
CLIPPING: Distilling CLIP-Based Models With a Student Base for Video-Language Retrieval CVPR 2023
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning Meets Knowledge Distillation CVPR 2023
Extremely Low Bit Quantization for Mobile Speaker Verification Systems Under 1MB Memory INTERSPEECH 2023
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression ACL 2023
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation ACL 2023
Architecture, Dataset and Model-Scale Agnostic Data-Free Meta-Learning CVPR 2023