conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Pruning Adatperfusion with Lottery Ticket Hypothesis NAACL 2022
Lost in Distillation: A Case Study in Toxicity Modeling NAACL 2022
Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models EMNLP 2022
JANUS: Joint Autoregressive and Non-autoregressive Training with Auxiliary Loss for Sequence Generation EMNLP 2022
Interspace Pruning: Using Adaptive Filter Representations To Improve Training of Sparse CNNs CVPR 2022
Learnable Lookup Table for Neural Network Quantization CVPR 2022
Condensing CNNs With Partial Differential Equations CVPR 2022
Structural and Statistical Texture Knowledge Distillation for Semantic Segmentation CVPR 2022
Fire Together Wire Together: A Dynamic Pruning Approach With Self-Supervised Mask Prediction CVPR 2022
AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot Network CVPR 2022
AlignQ: Alignment Quantization With ADMM-Based Correlation Preservation CVPR 2022
Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search CVPR 2022
Class-Incremental Learning by Knowledge Distillation With Adaptive Feature Consolidation CVPR 2022
Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability CVPR 2022
A Multi-Stage Multi-Codebook VQ-VAE Approach to High-Performance Neural TTS INTERSPEECH 2022
Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems EMNLP 2022
SpeechNet: Weakly Supervised, End-to-End Speech Recognition at Industrial Scale EMNLP 2022
Dynamic Forward and Backward Sparse Training (DFBST): Accelerated Deep Learning through Completely Sparse Training Schedule ACML 2022
HashFormers: Towards Vocabulary-independent Pre-trained Transformers EMNLP 2022
Efficient Adversarial Training with Robust Early-Bird Tickets EMNLP 2022
Unsupervised Non-transferable Text Classification EMNLP 2022
Modular and Parameter-Efficient Fine-Tuning for NLP Models EMNLP 2022
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token EMNLP 2022
From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models EMNLP 2022
Edinburgh’s Submission to the WMT 2022 Efficiency Task EMNLP 2022