← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Efficient Audio Captioning with Encoder-Level Knowledge Distillation INTERSPEECH 2024
Fine-Grained Distillation for Long Document Retrieval AAAI 2024
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models ACL 2024
Incremental Sequence Labeling: A Tale of Two Shifts ACL 2024
TIKP: Text-to-Image Knowledge Preservation for Continual Semantic Segmentation AAAI 2024
BPKD: Boundary Privileged Knowledge Distillation for Semantic Segmentation WACV 2024
Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios ACL 2024
Unsupervised Distractor Generation via Large Language Model Distilling and Counterfactual Contrastive Decoding ACL 2024
Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024
Reviewing the Forgotten Classes for Domain Adaptation of Black-Box Predictors AAAI 2024
Federated Learning via Input-Output Collaborative Distillation AAAI 2024
BOLD: Boolean Logic Deep Learning NIPS 2024
Frequency Attention for Knowledge Distillation WACV 2024
Flexible Weight Tuning and Weight Fusion Strategies for Continual Named Entity Recognition ACL 2024
Teacher-Student Training for Debiasing: General Permutation Debiasing for Large Language Models ACL 2024
Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation ACL 2024
Self-chats from Large Language Models Make Small Emotional Support Chatbot Better ACL 2024
LEDetection: A Simple Framework for Semi-Supervised Few-Shot Object Detection AISTATS 2024
Small But Funny: A Feedback-Driven Approach to Humor Distillation ACL 2024
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning AAAI 2024
DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models EMNLP 2024
Resource-Aware Federated Self-Supervised Learning with Global Class Representations NIPS 2024
Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation ACL 2024
Speedy Gonzales: A Collection of Fast Task-Specific Models for Spanish NAACL 2024
MTA4DPR: Multi-Teaching-Assistants Based Iterative Knowledge Distillation for Dense Passage Retrieval EMNLP 2024