knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

GSQA: An End-to-End Model for Generative Spoken Question Answering INTERSPEECH 2024

Aligning Vision Models with Human Aesthetics in Retrieval: Benchmarks and Algorithms NIPS 2024

D^4: Dataset Distillation via Disentangled Diffusion Model CVPR 2024

Plug-and-Play Diffusion Distillation CVPR 2024

Confidence Matters: Enhancing Medical Image Classification Through Uncertainty-Driven Contrastive Self-Distillation MICCAI 2024

FREE: Faster and Better Data-Free Meta-Learning CVPR 2024

Pauk at SemEval-2024 Task 4: A Neuro-Symbolic Method for Consistent Classification of Propaganda Techniques in Memes NAACL 2024

FastVoiceGrad: One-step Diffusion-Based Voice Conversion with Adversarial Conditional Diffusion Distillation INTERSPEECH 2024

UDON: Universal Dynamic Online distillatioN for generic image representations NIPS 2024

Weight-Inherited Distillation for Task-Agnostic BERT Compression NAACL 2024

Okay, Let’s Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation NAACL 2024

KDMCSE: Knowledge Distillation Multimodal Sentence Embeddings with Adaptive Angular margin Contrastive Learning NAACL 2024

TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation NAACL 2024

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation NIPS 2024

A Kernel Perspective on Distillation-based Collaborative Learning NIPS 2024

Frequency Attention for Knowledge Distillation WACV 2024

Reverse Knowledge Distillation: Training a Large Model Using a Small One for Retinal Image Matching on Limited Data WACV 2024

GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation NAACL 2024

Aggregate-and-Adapt Natural Language Prompts for Downstream Generalization of CLIP NIPS 2024

Persistence Homology Distillation for Semi-supervised Continual Learning NIPS 2024

Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study NIPS 2024

Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure NAACL 2024

Aligning Large Language Models with Recommendation Knowledge NAACL 2024

Self-Supervised Learning with Multi-Head Multi-Mode Knowledge Distillation for Speaker Verification INTERSPEECH 2024

PRVAE-VC2: Non-Parallel Voice Conversion by Distillation of Speech Representations INTERSPEECH 2024