conftrace_

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Accelerating Vision-Language Pretraining With Free Language Modeling CVPR 2023

Multi-Level Logit Distillation CVPR 2023

Open-Set Fine-Grained Retrieval via Prompting Vision-Language Evaluator CVPR 2023

HOICLIP: Efficient Knowledge Transfer for HOI Detection With Vision-Language Models CVPR 2023

DyLiN: Making Light Field Networks Dynamic CVPR 2023

Data-Free Knowledge Distillation via Feature Exchange and Activation Region Constraint CVPR 2023

Learning To Retain While Acquiring: Combating Distribution-Shift in Adversarial Data-Free Knowledge Distillation CVPR 2023

DiGA: Distil To Generalize and Then Adapt for Domain Adaptive Semantic Segmentation CVPR 2023

Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval CVPR 2023

1% VS 100%: Parameter-Efficient Low Rank Adapter for Dense Predictions CVPR 2023

ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model With Knowledge-Enhanced Mixture-of-Denoising-Experts CVPR 2023

On Distillation of Guided Diffusion Models CVPR 2023

RD-Suite: A Benchmark for Ranking Distillation NIPS 2023

On the Size and Approximation Error of Distilled Datasets NIPS 2023

KD-Zero: Evolving Knowledge Distiller for Any Teacher-Student Pairs NIPS 2023

Module-wise Adaptive Distillation for Multimodality Foundation Models NIPS 2023

Diffusion-Based Probabilistic Uncertainty Estimation for Active Domain Adaptation NIPS 2023

Accelerating Molecular Graph Neural Networks via Knowledge Distillation NIPS 2023

Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models NIPS 2023

Metis: Understanding and Enhancing In-Network Regular Expressions NIPS 2023

Should Under-parameterized Student Networks Copy or Average Teacher Weights? NIPS 2023

Reusing Pretrained Models by Multi-linear Operators for Efficient Training NIPS 2023

LLM-Pruner: On the Structural Pruning of Large Language Models NIPS 2023

Propagating Knowledge Updates to LMs Through Distillation NIPS 2023

Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive Tasks NIPS 2023