conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Consistency is Key: On Data-Efficient Modality Transfer in Speech Translation EMNLP 2023
InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT EMNLP 2023
D2TV: Dual Knowledge Distillation and Target-oriented Vision Modeling for Many-to-Many Multimodal Summarization EMNLP 2023
Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models EMNLP 2023
PersonalityChat: Conversation Distillation for Personalized Dialog Modeling with Facts and Traits EMNLP 2023
GPT4All: An Ecosystem of Open Source Compressed Language Models EMNLP 2023
Empowering Convolutional Neural Nets with MetaSin Activation NIPS 2023
DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning NIPS 2023
EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understanding NIPS 2023
Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation NIPS 2023
Knowledge Diffusion for Distillation NIPS 2023
An Efficient and Noise-Robust Audiovisual Encoder for Audiovisual Speech Recognition INTERSPEECH 2023
DIME-FM : DIstilling Multimodal and Efficient Foundation Models ICCV 2023
Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval EMNLP 2023
ICD-Face: Intra-class Compactness Distillation for Face Recognition ICCV 2023
Misalign, Contrast then Distill: Rethinking Misalignments in Language-Image Pre-training ICCV 2023
Heterogeneous Forgetting Compensation for Class-Incremental Learning ICCV 2023
Efficiently Robustify Pre-Trained Models ICCV 2023
MI-GAN: A Simple Baseline for Image Inpainting on Mobile Devices ICCV 2023
Distribution Shift Matters for Knowledge Distillation with Webly Collected Images ICCV 2023
CTP:Towards Vision-Language Continual Pretraining via Compatible Momentum Contrast and Topology Preservation ICCV 2023
Data-Free Class-Incremental Hand Gesture Recognition ICCV 2023
DualVC: Dual-mode Voice Conversion using Intra-model Knowledge Distillation and Hybrid Predictive Coding INTERSPEECH 2023
Multimodal Locally Enhanced Transformer for Continuous Sign Language Recognition INTERSPEECH 2023
DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models INTERSPEECH 2023