conftrace_
← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

CLIPPING: Distilling CLIP-Based Models With a Student Base for Video-Language Retrieval CVPR 2023
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning Meets Knowledge Distillation CVPR 2023
Extremely Low Bit Quantization for Mobile Speaker Verification Systems Under 1MB Memory INTERSPEECH 2023
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression ACL 2023
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation ACL 2023
Architecture, Dataset and Model-Scale Agnostic Data-Free Meta-Learning CVPR 2023
Continual Knowledge Distillation for Neural Machine Translation ACL 2023
ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression INTERSPEECH 2023
Fast as CHITA: Neural Network Pruning with Combinatorial Optimization ICML 2023
DoCoFL: Downlink Compression for Cross-Device Federated Learning ICML 2023
Structured Pruning for Efficient Generative Pre-trained Language Models ACL 2023
Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models ICML 2023
Practical Network Acceleration With Tiny Sets CVPR 2023
UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers ICML 2023
NoisyQuant: Noisy Bias-Enhanced Post-Training Activation Quantization for Vision Transformers CVPR 2023
MUX-PLMs: Pre-training Language Models with Data Multiplexing ACL 2023
PCNN: A Lightweight Parallel Conformer Neural Network for Efficient Monaural Speech Enhancement INTERSPEECH 2023
Recycle-and-Distill: Universal Compression Strategy for Transformer-based Speech SSL Models with Attention Map Reusing and Masking Distillation INTERSPEECH 2023
TexQ: Zero-shot Network Quantization with Texture Feature Distribution Calibration NIPS 2023
INGENIOUS: Using Informative Data Subsets for Efficient Pre-Training of Language Models EMNLP 2023
MCC-KD: Multi-CoT Consistent Knowledge Distillation EMNLP 2023
Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefix EMNLP 2023
DistillCSE: Distilled Contrastive Learning for Sentence Embeddings EMNLP 2023
Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023
Decomposed Prompt Tuning via Low-Rank Reparameterization EMNLP 2023