conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

GPT4All: An Ecosystem of Open Source Compressed Language Models EMNLP 2023
Empowering Convolutional Neural Nets with MetaSin Activation NIPS 2023
DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning NIPS 2023
EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understanding NIPS 2023
Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation NIPS 2023
Knowledge Diffusion for Distillation NIPS 2023
An Efficient and Noise-Robust Audiovisual Encoder for Audiovisual Speech Recognition INTERSPEECH 2023
DIME-FM : DIstilling Multimodal and Efficient Foundation Models ICCV 2023
Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval EMNLP 2023
ICD-Face: Intra-class Compactness Distillation for Face Recognition ICCV 2023
Misalign, Contrast then Distill: Rethinking Misalignments in Language-Image Pre-training ICCV 2023
Heterogeneous Forgetting Compensation for Class-Incremental Learning ICCV 2023
Efficiently Robustify Pre-Trained Models ICCV 2023
MI-GAN: A Simple Baseline for Image Inpainting on Mobile Devices ICCV 2023
Distribution Shift Matters for Knowledge Distillation with Webly Collected Images ICCV 2023
CTP:Towards Vision-Language Continual Pretraining via Compatible Momentum Contrast and Topology Preservation ICCV 2023
Data-Free Class-Incremental Hand Gesture Recognition ICCV 2023
DualVC: Dual-mode Voice Conversion using Intra-model Knowledge Distillation and Hybrid Predictive Coding INTERSPEECH 2023
Multimodal Locally Enhanced Transformer for Continuous Sign Language Recognition INTERSPEECH 2023
DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models INTERSPEECH 2023
Teacher-Generated Spatial-Attention Labels Boost Robustness and Accuracy of Contrastive Models CVPR 2023
Foundation Model Drives Weakly Incremental Learning for Semantic Segmentation CVPR 2023
Q-DETR: An Efficient Low-Bit Quantized Detection Transformer CVPR 2023
OVTrack: Open-Vocabulary Multiple Object Tracking CVPR 2023
Object-Aware Distillation Pyramid for Open-Vocabulary Object Detection CVPR 2023