← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Layer Compression of Deep Networks with Straight Flows AAAI 2024
Summarizing Stream Data for Memory-Constrained Online Continual Learning AAAI 2024
The ALCHEmist: Automated Labeling 500x CHEaper than LLM Data Annotators NIPS 2024
Logit Standardization in Knowledge Distillation CVPR 2024
KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling CVPR 2024
NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation CVPR 2024
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation NIPS 2024
Hierarchical Topology Isomorphism Expertise Embedded Graph Contrastive Learning AAAI 2024
Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation AAAI 2024
DC-NAS: Divide-and-Conquer Neural Architecture Search for Multi-Modal Classification AAAI 2024
Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching CVPR 2024
Holistic Features are almost Sufficient for Text-to-Video Retrieval CVPR 2024
Amortized Planning with Large-Scale Transformers: A Case Study on Chess NIPS 2024
On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion NIPS 2024
Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models CVPR 2024
Training a Better Chinese Spelling Correction Model via Prior-knowledge Guided Teacher ACL 2024
Cloud Object Detector Adaptation by Integrating Different Source Knowledge NIPS 2024
Cooperative Knowledge Distillation: A Learner Agnostic Approach AAAI 2024
PELA: Learning Parameter-Efficient Models with Low-Rank Approximation CVPR 2024
CLIP-KD: An Empirical Study of CLIP Model Distillation CVPR 2024
Scaled Decoupled Distillation CVPR 2024
How to Make Cross Encoder a Good Teacher for Efficient Image-Text Retrieval? CVPR 2024
Make Graph Neural Networks Great Again: A Generic Integration Paradigm of Topology-Free Patterns for Traffic Speed Prediction IJCAI 2024
Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition IJCAI 2024
FedPFT: Federated Proxy Fine-Tuning of Foundation Models IJCAI 2024