← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Don’t Take It Literally: An Edit-Invariant Sequence Loss for Text Generation NAACL 2022
KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation NAACL 2022
Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models NAACL 2022
Boosted Dense Retriever NAACL 2022
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline NAACL 2022
Knowledge Inheritance for Pre-trained Language Models NAACL 2022
Leaner and Faster: Two-Stage Model Compression for Lightweight Text-Image Retrieval NAACL 2022
Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training NAACL 2022
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models INTERSPEECH 2022
Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022
Causal Distillation for Language Models NAACL 2022
FNet: Mixing Tokens with Fourier Transforms NAACL 2022
SmartIdx: Reducing Communication Cost in Federated Learning by Exploiting the CNNs Structures AAAI 2022
Multi-Scale Distillation from Multiple Graph Neural Networks AAAI 2022
Knowledge Distillation via Constrained Variational Inference AAAI 2022
Hybrid Neural Networks for On-Device Directional Hearing AAAI 2022
Gradient and Mangitude Based Pruning for Sparse Deep Neural Networks AAAI 2022
Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learning ICML 2022
From Fully Trained to Fully Random Embeddings: Improving Neural Machine Translation with Compact Word Embedding Tables AAAI 2022
Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers AAAI 2022
FedDUAP: Federated Learning with Dynamic Update and Adaptive Pruning Using Shared Data on the Server IJCAI 2022
Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning IJCAI 2022
Pruning-as-Search: Efficient Neural Architecture Search via Channel Pruning and Structural Reparameterization IJCAI 2022
Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation CVPR 2022
Mr.BiQ: Post-Training Non-Uniform Quantization Based on Minimizing the Reconstruction Error CVPR 2022