knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes INTERSPEECH 2023

ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression INTERSPEECH 2023

Multi-Level Knowledge Distillation for Speech Emotion Recognition in Noisy Conditions INTERSPEECH 2023

LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation EACL 2023

On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation INTERSPEECH 2023

An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding INTERSPEECH 2023

SMOC-Net: Leveraging Camera Pose for Self-Supervised Monocular Object Pose Estimation CVPR 2023

Toward Fairness in Text Generation via Mutual Information Minimization based on Importance Sampling AISTATS 2023

Distilling Large Vision-Language Model with Out-of-Distribution Generalizability ICCV 2023

Accurate and Structured Pruning for Efficient Automatic Speech Recognition INTERSPEECH 2023

SSSD: Self-Supervised Self Distillation WACV 2023

Probabilistic Integration of Object Level Annotations in Chest X-Ray Classification WACV 2023

Few-Shot Learning of Compact Models via Task-Specific Meta Distillation WACV 2023

Adversarial Local Distribution Regularization for Knowledge Distillation WACV 2023

Conformer-based Language Embedding with Self-Knowledge Distillation for Spoken Language Identification INTERSPEECH 2023

Teamwork Is Not Always Good: An Empirical Study of Classifier Drift in Class-incremental Information Extraction ACL 2023

SSFE-Net: Self-Supervised Feature Enhancement for Ultra-Fine-Grained Few-Shot Class Incremental Learning WACV 2023

AttTrack: Online Deep Attention Transfer for Multi-Object Tracking WACV 2023

Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data INTERSPEECH 2023

Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation INTERSPEECH 2023

SALAD: Source-Free Active Label-Agnostic Domain Adaptation for Classification, Segmentation and Detection WACV 2023

Semantic Segmentation of Degraded Images Using Layer-Wise Feature Adjustor WACV 2023

TinyHD: Efficient Video Saliency Prediction With Heterogeneous Decoders Using Hierarchical Maps Distillation WACV 2023

FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection WACV 2023

Online Knowledge Distillation for Multi-Task Learning WACV 2023