conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data CVPR 2022
Open-Vocabulary One-Stage Detection With Hierarchical Visual-Language Knowledge Distillation CVPR 2022
Improving Video Model Transfer With Dynamic Representation Learning CVPR 2022
Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks NIPS 2022
Infinite Recommendation Networks: A Data-Centric Approach NIPS 2022
Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation NIPS 2022
Distilling Inter-Class Distance for Semantic Segmentation IJCAI 2022
TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation NIPS 2022
Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification NIPS 2022
Hilbert Distillation for Cross-Dimensionality Networks NIPS 2022
Label Hallucination for Few-Shot Classification AAAI 2022
Structural Knowledge Distillation for Object Detection NIPS 2022
DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization ACL 2022
Being Friends Instead of Adversaries: Deep Networks Learn from Data Simplified by Other Networks AAAI 2022
Knowledge Distillation via Constrained Variational Inference AAAI 2022
Evaluation-Oriented Knowledge Distillation for Deep Face Recognition CVPR 2022
Representation Compensation Networks for Continual Semantic Segmentation CVPR 2022
Focal and Global Knowledge Distillation for Detectors CVPR 2022
Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation CVPR 2022
Maximum Bayes Smatch Ensemble Distillation for AMR Parsing NAACL 2022
Lite-MDETR: A Lightweight Multi-Modal Detector CVPR 2022
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora NAACL 2022
Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022
LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency COLING 2022
A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck COLING 2022