conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Improving Zero-Shot Multilingual Text Generation via Iterative Distillation COLING 2022
Enhancing Task-Specific Distillation in Small Data Regimes through Language Generation COLING 2022
Sentiment Interpretable Logic Tensor Network for Aspect-Term Sentiment Analysis COLING 2022
Making Parameter-efficient Tuning More Efficient: A Unified Framework for Classification Tasks COLING 2022
When the Student Becomes the Master: Learning Better and Smaller Monolingual Models from mBERT COLING 2022
FreeTransfer-X: Safe and Label-Free Cross-Lingual Transfer from Off-the-Shelf Models NAACL 2022
LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Framework NAACL 2022
RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation NAACL 2022
Distilling Hypernymy Relations from Language Models: On the Effectiveness of Zero-Shot Taxonomy Induction NAACL 2022
KSAM: Infusing Multi-Source Knowledge into Dialogue Generation via Knowledge Source Aware Multi-Head Decoding ACL 2022
bert2BERT: Towards Reusable Pretrained Language Models ACL 2022
Domain-specific knowledge distillation yields smaller and better models for conversational commerce ACL 2022
Sample, Translate, Recombine: Leveraging Audio Alignments for Data Augmentation in End-to-end Speech Translation ACL 2022
Improving Machine Reading Comprehension with Contextualized Commonsense Knowledge ACL 2022
Contextual Fine-to-Coarse Distillation for Coarse-grained Response Selection in Open-Domain Conversations ACL 2022
Redistributing Low-Frequency Words: Making the Most of Monolingual Data in Non-Autoregressive Translation ACL 2022
Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency Gaps AACL 2022
Modeling Document-level Temporal Structures for Building Temporal Dependency Graphs AACL 2022
Static-Dynamic Co-teaching for Class-Incremental 3D Object Detection AAAI 2022
Pose-Invariant Face Recognition via Adaptive Angular Distillation AAAI 2022
Cycle class consistency with distributional optimal transport and knowledge distillation for unsupervised domain adaptation UAI 2022
Aligned Weight Regularizers for Pruning Pretrained Neural Networks ACL 2022
A Self-improving Skin Lesions Diagnosis Framework Via Pseudo-labeling and Self-distillation ACML 2022
Towards Data-Free Domain Generalization ACML 2022
Are All Linear Regions Created Equal? AISTATS 2022