conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Improving Prediction Backward-Compatiblility in NLP Model Upgrade with Gated Fusion EACL 2023
Coaching a Teachable Student CVPR 2023
Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial Distillation CVPR 2023
USTC-NELSLIP at SemEval-2023 Task 2: Statistical Construction and Dual Adaptation of Gazetteer for Multilingual Complex NER SEMEVAL 2023
Distilling Influences to Mitigate Prediction Churn in Graph Neural Networks ACML 2023
Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation EACL 2023
Syntax-guided Neural Module Distillation to Probe Compositionality in Sentence Embeddings EACL 2023
Do we need Label Regularization to Fine-tune Pre-trained Language Models? EACL 2023
DiffSLU: Knowledge Distillation Based Diffusion Model for Cross-Lingual Spoken Language Understanding INTERSPEECH 2023
Distillation of encoder-decoder transformers for sequence labelling EACL 2023
Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding EACL 2023
Integrating Translation Memories into Non-Autoregressive Machine Translation EACL 2023
TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance ICCV 2023
TARGET: Federated Class-Continual Learning via Exemplar-Free Distillation ICCV 2023
Pixel-Wise Contrastive Distillation ICCV 2023
ML Mob at SemEval-2023 Task 5: “Breaking News: Our Semi-Supervised and Multi-Task Learning Approach Spoils Clickbait” SEMEVAL 2023
Differentially Private Adapters for Parameter Efficient Acoustic Modeling INTERSPEECH 2023
Models Teaching Models: Improving Model Accuracy with Slingshot Learning EACL 2023
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023
NoreSpeech: Knowledge Distillation based Conditional Diffusion Model for Noise-robust Expressive TTS INTERSPEECH 2023
DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes INTERSPEECH 2023
ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression INTERSPEECH 2023
Multi-Level Knowledge Distillation for Speech Emotion Recognition in Noisy Conditions INTERSPEECH 2023
LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation EACL 2023
On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation INTERSPEECH 2023