← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

MEID: Mixture-of-Experts with Internal Distillation for Long-Tailed Video Recognition AAAI 2023
Boosting Graph Neural Networks via Adaptive Knowledge Distillation AAAI 2023
Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting It into MLPs: An Effective GNN-to-MLP Distillation Framework AAAI 2023
Lifelong Variational Autoencoder via Online Adversarial Expansion Strategy AAAI 2023
Continual Variational Autoencoder via Continual Generative Knowledge Distillation AAAI 2023
Cross-Modal Distillation for Speaker Recognition AAAI 2023
Four Approaches to Low-Resource Multilingual NMT: The Helsinki Submission to the AmericasNLP 2023 Shared Task ACL 2023
Beyond the Limitation of Monocular 3D Detector via Knowledge Distillation ICCV 2023
Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23 ACL 2023
DOT: A Distillation-Oriented Trainer ICCV 2023
DETRDistill: A Universal Knowledge Distillation Framework for DETR-families ICCV 2023
Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks Using an Incompetent Teacher AAAI 2023
ProKD: An Unsupervised Prototypical Knowledge Distillation Network for Zero-Resource Cross-Lingual Named Entity Recognition AAAI 2023
An Ensemble Distillation Framework for Sentence Embeddings with Multilingual Round-Trip Translation AAAI 2023
Spectral Co-Distillation for Personalized Federated Learning NIPS 2023
Improving Adversarial Robustness via Information Bottleneck Distillation NIPS 2023
FSAR: Federated Skeleton-based Action Recognition with Adaptive Topology Structure and Knowledge Distillation ICCV 2023
Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection ICCV 2023
Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection ICCV 2023
T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillation AAAI 2023
Exploring Self-Distillation Based Relational Reasoning Training for Document-Level Relation Extraction AAAI 2023
ProtoTransfer: Cross-Modal Prototype Transfer for Point Cloud Segmentation ICCV 2023
The economic trade-offs of large language models: A case study ACL 2023
Class Lifelong Learning for Intent Detection via Structure Consolidation Networks ACL 2023
TempLM: Distilling Language Models into Template-Based Generators ACL 2023