conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification CVPR 2024
Reinforced Cross-Domain Knowledge Distillation on Time Series Data NIPS 2024
KOALA: Empirical Lessons Toward Memory-Efficient and Fast Diffusion Models for Text-to-Image Synthesis NIPS 2024
PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher NIPS 2024
SAM-Guided Masked Token Prediction for 3D Scene Understanding NIPS 2024
2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution NIPS 2024
A Unified Framework for 3D Scene Understanding NIPS 2024
Improved Distribution Matching Distillation for Fast Image Synthesis NIPS 2024
Large Language Models for Time Series: A Survey IJCAI 2024
Self-Regulated Data-Free Knowledge Amalgamation for Text Classification NAACL 2024
Distilling Text Style Transfer With Self-Explanation From LLMs NAACL 2024
Unveiling the Magic: Investigating Attention Distillation in Retrieval-Augmented Generation NAACL 2024
DistilVPR: Cross-Modal Knowledge Distillation for Visual Place Recognition AAAI 2024
Crayon: Customized On-Device LLM via Instant Adapter Blending and Edge-Server Hybrid Inference ACL 2024
DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models EMNLP 2024
MTA4DPR: Multi-Teaching-Assistants Based Iterative Knowledge Distillation for Dense Passage Retrieval EMNLP 2024
MGCL: Multi-Granularity Clue Learning for Emotion-Cause Pair Extraction via Cross-Grained Knowledge Distillation EMNLP 2024
VE-KD: Vocabulary-Expansion Knowledge-Distillation for Training Smaller Domain-Specific Language Models EMNLP 2024
LaKD: Length-agnostic Knowledge Distillation for Trajectory Prediction with Any Length Observations NIPS 2024
ScaleKD: Strong Vision Transformers Could Be Excellent Teachers NIPS 2024
Improving the Training of Rectified Flows NIPS 2024
SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams NIPS 2024
BOLD: Boolean Logic Deep Learning NIPS 2024
BiDM: Pushing the Limit of Quantization for Diffusion Models NIPS 2024
Low-Complexity Acoustic Scene Classification Using Parallel Attention-Convolution Network INTERSPEECH 2024