← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillation ICML 2023
No One Idles: Efficient Heterogeneous Federated Learning with Parallel Edge and Server Computation ICML 2023
On the Impact of Knowledge Distillation for Model Interpretability ICML 2023
Learning to Learn from APIs: Black-Box Data-Free Meta-Learning ICML 2023
NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion ICML 2023
Improving Prediction Backward-Compatiblility in NLP Model Upgrade with Gated Fusion EACL 2023
Coaching a Teachable Student CVPR 2023
Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial Distillation CVPR 2023
USTC-NELSLIP at SemEval-2023 Task 2: Statistical Construction and Dual Adaptation of Gazetteer for Multilingual Complex NER SEMEVAL 2023
Distilling Influences to Mitigate Prediction Churn in Graph Neural Networks ACML 2023
Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation EACL 2023
Syntax-guided Neural Module Distillation to Probe Compositionality in Sentence Embeddings EACL 2023
Do we need Label Regularization to Fine-tune Pre-trained Language Models? EACL 2023
DiffSLU: Knowledge Distillation Based Diffusion Model for Cross-Lingual Spoken Language Understanding INTERSPEECH 2023
Distillation of encoder-decoder transformers for sequence labelling EACL 2023
Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding EACL 2023
Integrating Translation Memories into Non-Autoregressive Machine Translation EACL 2023
TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance ICCV 2023
TARGET: Federated Class-Continual Learning via Exemplar-Free Distillation ICCV 2023
Pixel-Wise Contrastive Distillation ICCV 2023
ML Mob at SemEval-2023 Task 5: “Breaking News: Our Semi-Supervised and Multi-Task Learning Approach Spoils Clickbait” SEMEVAL 2023
Differentially Private Adapters for Parameter Efficient Acoustic Modeling INTERSPEECH 2023
Models Teaching Models: Improving Model Accuracy with Slingshot Learning EACL 2023
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023
NoreSpeech: Knowledge Distillation based Conditional Diffusion Model for Noise-robust Expressive TTS INTERSPEECH 2023