← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Structured Pruning Learns Compact and Accurate Models ACL 2022
Compression of Generative Pre-trained Language Models via Quantization ACL 2022
E-LANG: Energy-Based Joint Inferencing of Super and Swift Language Models ACL 2022
Aligned Weight Regularizers for Pruning Pretrained Neural Networks ACL 2022
Domain-specific knowledge distillation yields smaller and better models for conversational commerce ACL 2022
DACT-BERT: Differentiable Adaptive Computation Time for an Efficient BERT Inference ACL 2022
SDR: Efficient Neural Re-ranking using Succinct Document Representation ACL 2022
Sparsifying Transformer Models with Trainable Representation Pooling ACL 2022
PATS: Sensitivity-aware Noisy Learning for Pretrained Language Models EMNLP 2022
Sparse Teachers Can Be Dense with Knowledge EMNLP 2022
Wider & Closer: Mixture of Short-channel Distillers for Zero-shot Cross-lingual Named Entity Recognition EMNLP 2022
Hypoformer: Hybrid Decomposition Transformer for Edge-friendly Neural Machine Translation EMNLP 2022
Distilled Dual-Encoder Model for Vision-Language Understanding EMNLP 2022
Intriguing Properties of Compression on Multilingual Models EMNLP 2022
BMCook: A Task-agnostic Compression Toolkit for Big Models EMNLP 2022
FPT: Improving Prompt Tuning Efficiency via Progressive Training EMNLP 2022
Algorithmic Diversity and Tiny Models: Comparing Binary Networks and the Fruit Fly Algorithm on Document Representation Tasks EMNLP 2022
Findings of the WMT 2022 Shared Task on Efficient Translation EMNLP 2022
Too Brittle to Touch: Comparing the Stability of Quantization and Distillation towards Developing Low-Resource MT Models EMNLP 2022
Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders EMNLP 2022
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation EMNLP 2022
Fast Vocabulary Transfer for Language Model Compression EMNLP 2022
Fine-mixing: Mitigating Backdoors in Fine-tuned Language Models EMNLP 2022
HW-TSC’s Submission for the WMT22 Efficiency Task EMNLP 2022
Efficient Two-Stage Progressive Quantization of BERT EMNLP 2022