← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

DeiT-LT: Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets CVPR 2024
Your Student is Better Than Expected: Adaptive Teacher-Student Collaboration for Text-Conditional Diffusion Models CVPR 2024
SinSR: Diffusion-Based Image Super-Resolution in a Single Step CVPR 2024
Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline CVPR 2024
Wired Perspectives: Multi-View Wire Art Embraces Generative AI CVPR 2024
Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification CVPR 2024
Reinforced Cross-Domain Knowledge Distillation on Time Series Data NIPS 2024
KOALA: Empirical Lessons Toward Memory-Efficient and Fast Diffusion Models for Text-to-Image Synthesis NIPS 2024
PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher NIPS 2024
SAM-Guided Masked Token Prediction for 3D Scene Understanding NIPS 2024
2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution NIPS 2024
A Unified Framework for 3D Scene Understanding NIPS 2024
Improved Distribution Matching Distillation for Fast Image Synthesis NIPS 2024
Large Language Models for Time Series: A Survey IJCAI 2024
Self-Regulated Data-Free Knowledge Amalgamation for Text Classification NAACL 2024
Distilling Text Style Transfer With Self-Explanation From LLMs NAACL 2024
Unveiling the Magic: Investigating Attention Distillation in Retrieval-Augmented Generation NAACL 2024
DistilVPR: Cross-Modal Knowledge Distillation for Visual Place Recognition AAAI 2024
Crayon: Customized On-Device LLM via Instant Adapter Blending and Edge-Server Hybrid Inference ACL 2024
DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models EMNLP 2024
MTA4DPR: Multi-Teaching-Assistants Based Iterative Knowledge Distillation for Dense Passage Retrieval EMNLP 2024
MGCL: Multi-Granularity Clue Learning for Emotion-Cause Pair Extraction via Cross-Grained Knowledge Distillation EMNLP 2024
VE-KD: Vocabulary-Expansion Knowledge-Distillation for Training Smaller Domain-Specific Language Models EMNLP 2024
LaKD: Length-agnostic Knowledge Distillation for Trajectory Prediction with Any Length Observations NIPS 2024
ScaleKD: Strong Vision Transformers Could Be Excellent Teachers NIPS 2024