conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Leaner and Faster: Two-Stage Model Compression for Lightweight Text-Image Retrieval NAACL 2022
Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training NAACL 2022
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models INTERSPEECH 2022
Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022
Causal Distillation for Language Models NAACL 2022
FNet: Mixing Tokens with Fourier Transforms NAACL 2022
SmartIdx: Reducing Communication Cost in Federated Learning by Exploiting the CNNs Structures AAAI 2022
Multi-Scale Distillation from Multiple Graph Neural Networks AAAI 2022
Knowledge Distillation via Constrained Variational Inference AAAI 2022
Hybrid Neural Networks for On-Device Directional Hearing AAAI 2022
Gradient and Mangitude Based Pruning for Sparse Deep Neural Networks AAAI 2022
Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learning ICML 2022
From Fully Trained to Fully Random Embeddings: Improving Neural Machine Translation with Compact Word Embedding Tables AAAI 2022
Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers AAAI 2022
FedDUAP: Federated Learning with Dynamic Update and Adaptive Pruning Using Shared Data on the Server IJCAI 2022
Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning IJCAI 2022
Pruning-as-Search: Efficient Neural Architecture Search via Channel Pruning and Structural Reparameterization IJCAI 2022
Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation CVPR 2022
Mr.BiQ: Post-Training Non-Uniform Quantization Based on Minimizing the Reconstruction Error CVPR 2022
Evaluation-Oriented Knowledge Distillation for Deep Face Recognition CVPR 2022
Lite-MDETR: A Lightweight Multi-Modal Detector CVPR 2022
Online Convolutional Re-Parameterization CVPR 2022
Slimmable Domain Adaptation CVPR 2022
Lite Pose: Efficient Architecture Design for 2D Human Pose Estimation CVPR 2022
Proper Reuse of Image Classification Features Improves Object Detection CVPR 2022