← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Self-chats from Large Language Models Make Small Emotional Support Chatbot Better ACL 2024
Small But Funny: A Feedback-Driven Approach to Humor Distillation ACL 2024
Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation ACL 2024
D2LLM: Decomposed and Distilled Large Language Models for Semantic Search ACL 2024
Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition ACL 2024
Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios ACL 2024
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models ACL 2024
Incremental Sequence Labeling: A Tale of Two Shifts ACL 2024
Unsupervised Distractor Generation via Large Language Model Distilling and Counterfactual Contrastive Decoding ACL 2024
Flexible Weight Tuning and Weight Fusion Strategies for Continual Named Entity Recognition ACL 2024
Teacher-Student Training for Debiasing: General Permutation Debiasing for Large Language Models ACL 2024
Distilling Robustness into Natural Language Inference Models with Domain-Targeted Augmentation ACL 2024
ELAD: Explanation-Guided Large Language Models Active Distillation ACL 2024
PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs ACL 2024
DIMSIM: Distilled Multilingual Critics for Indic Text Simplification ACL 2024
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning ACL 2024
Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation ACL 2024
A Privacy-preserving Approach to Ingest Knowledge from Proprietary Web-based to Locally Run Models for Medical Progress Note Generation ACL 2024
Incremental pre-training from smaller language models ACL 2024
CTYUN-AI@SMM4H-2024: Knowledge Extension Makes Expert Models ACL 2024
Knowledge Distillation from Monolingual to Multilingual Models for Intelligent and Interpretable Multilingual Emotion Detection ACL 2024
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment ACL 2024
Optimal Transport Guided Correlation Assignment for Multimodal Entity Linking ACL 2024
RECOST: External Knowledge Guided Data-efficient Instruction Tuning ACL 2024
Distillation Enhanced Generative Retrieval ACL 2024