conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

DiMS: Distilling Multiple Steps of Iterative Non-Autoregressive Transformers for Machine Translation ACL 2023
Better Simultaneous Translation with Monotonic Knowledge Distillation ACL 2023
Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts ACL 2023
Domain Generalization via Switch Knowledge Distillation for Robust Review Representation ACL 2023
MCC-KD: Multi-CoT Consistent Knowledge Distillation EMNLP 2023
Contrastive Distant Supervision for Debiased and Denoised Machine Reading Comprehension EMNLP 2023
Task-Attentive Transformer Architecture for Continual Learning of Vision-and-Language Tasks Using Knowledge Distillation EMNLP 2023
Enhancing Abstractiveness of Summarization Models through Calibrated Distillation EMNLP 2023
UGC: Unified GAN Compression for Efficient Image-to-Image Translation ICCV 2023
SSDA: Secure Source-Free Domain Adaptation ICCV 2023
Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoff ICCV 2023
Enhancing Adversarial Robustness in Low-Label Regime via Adaptively Weighted Regularization and Knowledge Distillation ICCV 2023
Tiny Updater: Towards Efficient Neural Network-Driven Software Updating ICCV 2023
Multi-Label Knowledge Distillation ICCV 2023
Cumulative Spatial Knowledge Distillation for Vision Transformers ICCV 2023
Borrowing Knowledge From Pre-trained Language Model: A New Data-efficient Visual Learning Paradigm ICCV 2023
Disposable Transfer Learning for Selective Source Task Unlearning ICCV 2023
Foreground Object Search by Distilling Composite Image Feature ICCV 2023
DreamTeacher: Pretraining Image Backbones with Deep Generative Models ICCV 2023
Incorporating Unlikely Negative Cues for Distinctive Image Captioning IJCAI 2023
DAMO-StreamNet: Optimizing Streaming Perception in Autonomous Driving IJCAI 2023
Low-Confidence Samples Mining for Semi-supervised Object Detection IJCAI 2023
Dual Relation Knowledge Distillation for Object Detection IJCAI 2023
RAIN: RegulArization on Input and Network for Black-Box Domain Adaptation IJCAI 2023
Distilling Coarse-to-Fine Semantic Matching Knowledge for Weakly Supervised 3D Visual Grounding ICCV 2023