conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Deep Compression of Pre-trained Transformer Models NIPS 2022
Training Spiking Neural Networks with Local Tandem Learning NIPS 2022
Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural Networks NIPS 2022
Weighted Mutual Learning with Diversity-Driven Model Compression NIPS 2022
Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation NIPS 2022
Weighted Distillation with Unlabeled Examples NIPS 2022
Discovering and Overcoming Limitations of Noise-engineered Data-free Knowledge Distillation NIPS 2022
Preservation of the Global Knowledge by Not-True Distillation in Federated Learning NIPS 2022
Information-Theoretic GAN Compression with Variational Energy-based Model NIPS 2022
Uncertainty-Aware Hierarchical Refinement for Incremental Implicitly-Refined Classification NIPS 2022
Association Graph Learning for Multi-Task Classification with Category Shifts NIPS 2022
Efficient Knowledge Distillation from Model Checkpoints NIPS 2022
Single-Domain Generalized Object Detection in Urban Scene via Cyclic-Disentangled Self-Distillation CVPR 2022
Cross-Domain Adaptive Teacher for Object Detection CVPR 2022
Point-Level Region Contrast for Object Detection Pre-Training CVPR 2022
EyePAD++: A Distillation-Based Approach for Joint Eye Authentication and Presentation Attack Detection Using Periocular Images CVPR 2022
Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning CVPR 2022
Dataset Distillation by Matching Training Trajectories CVPR 2022
Controllable Dynamic Multi-Task Architectures CVPR 2022
Fine-Tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning CVPR 2022
How Many Observations Are Enough? Knowledge Distillation for Trajectory Forecasting CVPR 2022
It's All in the Teacher: Zero-Shot Quantization Brought Closer to the Teacher CVPR 2022
IntraQ: Learning Synthetic Images With Intra-Class Heterogeneity for Zero-Shot Network Quantization CVPR 2022
Multi-Objective Diverse Human Motion Prediction With Knowledge Distillation CVPR 2022
Cloth-Changing Person Re-Identification From a Single Image With Gait Prediction and Regularization CVPR 2022