conftrace_

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding INTERSPEECH 2023

SMOC-Net: Leveraging Camera Pose for Self-Supervised Monocular Object Pose Estimation CVPR 2023

Toward Fairness in Text Generation via Mutual Information Minimization based on Importance Sampling AISTATS 2023

Distilling Large Vision-Language Model with Out-of-Distribution Generalizability ICCV 2023

Accurate and Structured Pruning for Efficient Automatic Speech Recognition INTERSPEECH 2023

SSSD: Self-Supervised Self Distillation WACV 2023

Probabilistic Integration of Object Level Annotations in Chest X-Ray Classification WACV 2023

Few-Shot Learning of Compact Models via Task-Specific Meta Distillation WACV 2023

Adversarial Local Distribution Regularization for Knowledge Distillation WACV 2023

Conformer-based Language Embedding with Self-Knowledge Distillation for Spoken Language Identification INTERSPEECH 2023

Teamwork Is Not Always Good: An Empirical Study of Classifier Drift in Class-incremental Information Extraction ACL 2023

SSFE-Net: Self-Supervised Feature Enhancement for Ultra-Fine-Grained Few-Shot Class Incremental Learning WACV 2023

AttTrack: Online Deep Attention Transfer for Multi-Object Tracking WACV 2023

Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data INTERSPEECH 2023

Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation INTERSPEECH 2023

SALAD: Source-Free Active Label-Agnostic Domain Adaptation for Classification, Segmentation and Detection WACV 2023

Semantic Segmentation of Degraded Images Using Layer-Wise Feature Adjustor WACV 2023

TinyHD: Efficient Video Saliency Prediction With Heterogeneous Decoders Using Hierarchical Maps Distillation WACV 2023

FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection WACV 2023

Online Knowledge Distillation for Multi-Task Learning WACV 2023

Multimodal Distillation for Egocentric Action Recognition ICCV 2023

DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model INTERSPEECH 2023

Distilling Reasoning Capabilities into Smaller Language Models ACL 2023

SememeASR: Boosting Performance of End-to-End Speech Recognition against Domain and Long-Tailed Data Shift with Sememe Semantic Knowledge INTERSPEECH 2023

Contrastive Knowledge-Augmented Meta-Learning for Few-Shot Classification WACV 2023