conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting EMNLP 2023
Distilling ChatGPT for Explainable Automated Student Answer Assessment EMNLP 2023
When Prompt-based Incremental Learning Does Not Meet Strong Pretraining ICCV 2023
How to Train Your Dragon: Diverse Augmentation Towards Generalizable Dense Retrieval EMNLP 2023
Teacher and Student Models of Offensive Language in Social Media ACL 2023
DiMS: Distilling Multiple Steps of Iterative Non-Autoregressive Transformers for Machine Translation ACL 2023
Better Simultaneous Translation with Monotonic Knowledge Distillation ACL 2023
Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts ACL 2023
Domain Generalization via Switch Knowledge Distillation for Robust Review Representation ACL 2023
MCC-KD: Multi-CoT Consistent Knowledge Distillation EMNLP 2023
Contrastive Distant Supervision for Debiased and Denoised Machine Reading Comprehension EMNLP 2023
Task-Attentive Transformer Architecture for Continual Learning of Vision-and-Language Tasks Using Knowledge Distillation EMNLP 2023
Enhancing Abstractiveness of Summarization Models through Calibrated Distillation EMNLP 2023
UGC: Unified GAN Compression for Efficient Image-to-Image Translation ICCV 2023
SSDA: Secure Source-Free Domain Adaptation ICCV 2023
Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoff ICCV 2023
Enhancing Adversarial Robustness in Low-Label Regime via Adaptively Weighted Regularization and Knowledge Distillation ICCV 2023
Tiny Updater: Towards Efficient Neural Network-Driven Software Updating ICCV 2023
Multi-Label Knowledge Distillation ICCV 2023
Cumulative Spatial Knowledge Distillation for Vision Transformers ICCV 2023
Borrowing Knowledge From Pre-trained Language Model: A New Data-efficient Visual Learning Paradigm ICCV 2023
Disposable Transfer Learning for Selective Source Task Unlearning ICCV 2023
Foreground Object Search by Distilling Composite Image Feature ICCV 2023
DreamTeacher: Pretraining Image Backbones with Deep Generative Models ICCV 2023
Incorporating Unlikely Negative Cues for Distinctive Image Captioning IJCAI 2023