conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation CVPR 2024
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation NIPS 2024
Hierarchical Topology Isomorphism Expertise Embedded Graph Contrastive Learning AAAI 2024
Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation AAAI 2024
DC-NAS: Divide-and-Conquer Neural Architecture Search for Multi-Modal Classification AAAI 2024
Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching CVPR 2024
Holistic Features are almost Sufficient for Text-to-Video Retrieval CVPR 2024
Amortized Planning with Large-Scale Transformers: A Case Study on Chess NIPS 2024
On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion NIPS 2024
Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models CVPR 2024
Training a Better Chinese Spelling Correction Model via Prior-knowledge Guided Teacher ACL 2024
Cloud Object Detector Adaptation by Integrating Different Source Knowledge NIPS 2024
Cooperative Knowledge Distillation: A Learner Agnostic Approach AAAI 2024
PELA: Learning Parameter-Efficient Models with Low-Rank Approximation CVPR 2024
CLIP-KD: An Empirical Study of CLIP Model Distillation CVPR 2024
Scaled Decoupled Distillation CVPR 2024
How to Make Cross Encoder a Good Teacher for Efficient Image-Text Retrieval? CVPR 2024
Make Graph Neural Networks Great Again: A Generic Integration Paradigm of Topology-Free Patterns for Traffic Speed Prediction IJCAI 2024
Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition IJCAI 2024
FedPFT: Federated Proxy Fine-Tuning of Foundation Models IJCAI 2024
Dual Expert Distillation Network for Generalized Zero-Shot Learning IJCAI 2024
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning AAAI 2024
Decoupled Kullback-Leibler Divergence Loss NIPS 2024
Gradient Reweighting: Towards Imbalanced Class-Incremental Learning CVPR 2024
A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition CVPR 2024