← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Domain-Aware Contrastive Knowledge Transfer for Multi-domain Imbalanced Data ACL 2022
Knowledge Distillation Meets Few-Shot Learning: An Approach for Few-Shot Intent Classification Within and Across Domains ACL 2022
KSAM: Infusing Multi-Source Knowledge into Dialogue Generation via Knowledge Source Aware Multi-Head Decoding ACL 2022
Pretrained Speech Encoders and Efficient Fine-tuning Methods for Speech Translation: UPC at IWSLT 2022 ACL 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing EMNLP 2022
Model Distillation for Faithful Explanations of Medical Code Predictions ACL 2022
bert2BERT: Towards Reusable Pretrained Language Models ACL 2022
Low Resource Causal Event Detection from Biomedical Literature ACL 2022
The AISP-SJTU Translation System for WMT 2022 EMNLP 2022
Offline Multi-Agent Reinforcement Learning with Knowledge Distillation NIPS 2022
Meta-Learning with Self-Improving Momentum Target NIPS 2022
Symbolic Distillation for Learned TCP Congestion Control NIPS 2022
Rethinking Task-Specific Knowledge Distillation: Contextualized Corpus as Better Textbook EMNLP 2022
ZeroGen: Efficient Zero-shot Learning via Dataset Generation EMNLP 2022
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora ACL 2022
BERT Learns to Teach: Knowledge Distillation with Meta Learning ACL 2022
Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency ACL 2022
ASCM: An Answer Space Clustered Prompting Method without Answer Engineering ACL 2022
DNA: Proximal Policy Optimization with a Dual Network Architecture NIPS 2022
Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic Samples ACL 2022
Domain-specific knowledge distillation yields smaller and better models for conversational commerce ACL 2022
Transn’s Submissions to the WMT22 Translation Suggestion Task EMNLP 2022
Too Brittle to Touch: Comparing the Stability of Quantization and Distillation towards Developing Low-Resource MT Models EMNLP 2022
Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems EMNLP 2022
Sample, Translate, Recombine: Leveraging Audio Alignments for Data Augmentation in End-to-end Speech Translation ACL 2022