← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Data-Free Adversarial Knowledge Distillation for Graph Neural Networks IJCAI 2022
Pseudo-spherical Knowledge Distillation IJCAI 2022
MultiQuant: Training Once for Multi-bit Quantization of Neural Networks IJCAI 2022
BiFSMN: Binary Neural Network for Keyword Spotting IJCAI 2022
Neural Network Pruning by Cooperative Coevolution IJCAI 2022
Distilling Inter-Class Distance for Semantic Segmentation IJCAI 2022
Distilling a Pretrained Language Model to a Multilingual ASR Model INTERSPEECH 2022
TRILLsson: Distilled Universal Paralinguistic Speech Representations INTERSPEECH 2022
Bunched LPCNet2: Efficient Neural Vocoders Covering Devices from Cloud to Edge INTERSPEECH 2022
Monarch: Expressive Structured Matrices for Efficient and Accurate Training ICML 2022
SPDY: Accurate Pruning with Speedup Guarantees ICML 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks ICML 2022
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale ICML 2022
QSFL: A Two-Level Uplink Communication Optimization Framework for Federated Learning ICML 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks ICML 2022
Resilient and Communication Efficient Learning for Heterogeneous Federated Systems ICML 2022
An Effective Post-training Embedding Binarization Approach for Fast Online Top-K Passage Matching IJCNLP 2022
Binary Early-Exit Network for Adaptive Inference on Low-Resource Devices INTERSPEECH 2022
A Passive Similarity based CNN Filter Pruning for Efficient Acoustic Scene Classification INTERSPEECH 2022
Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning INTERSPEECH 2022
Tiny-Sepformer: A Tiny Time-Domain Transformer Network For Speech Separation INTERSPEECH 2022
ResectNet: An Efficient Architecture for Voice Activity Detection on Mobile Devices INTERSPEECH 2022
Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks COLING 2022
LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency COLING 2022
MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation NAACL 2022