conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

EM Distillation for One-step Diffusion Models NIPS 2024
DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion NIPS 2024
Domain Adaptation for Large-Vocabulary Object Detectors NIPS 2024
Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging NIPS 2024
Distilled Datamodel with Reverse Gradient Matching CVPR 2024
Consistency Policy: Accelerated Visuomotor Policies via Consistency Distillation RSS 2024
Exploiting CLIP for Zero-Shot HOI Detection Requires Knowledge Distillation at Multiple Levels WACV 2024
Using Early Readouts To Mediate Featural Bias in Distillation WACV 2024
Cutting the Black Box: Conceptual Interpretation of a Deep Neural Net with Multi-Modal Embeddings and Multi-Criteria Decision Aid IJCAI 2024
D3ETR: Decoder Distillation for Detection Transformer IJCAI 2024
Label-efficient Semantic Scene Completion with Scribble Annotations IJCAI 2024
Navigating Continual Test-time Adaptation with Symbiosis Knowledge IJCAI 2024
Bridging Language Gaps in Audio-Text Retrieval INTERSPEECH 2024
Beyond Full Fine-tuning: Harnessing the Power of LoRA for Multi-Task Instruction Tuning COLING 2024
Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought COLING 2024
Enhancing Code Generation Performance of Smaller Models by Distilling the Reasoning Ability of LLMs COLING 2024
MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation NAACL 2024
ToXCL: A Unified Framework for Toxic Speech Detection and Explanation NAACL 2024
CodecLM: Aligning Language Models with Tailored Synthetic Data NAACL 2024
Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels NAACL 2024
LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions EACL 2024
Generation, Distillation and Evaluation of Motivational Interviewing-Style Reflections with a Foundational Language Model EACL 2024
On-the-fly Denoising for Data Augmentation in Natural Language Understanding EACL 2024
Scalable and Domain-General Abstractive Proposition Segmentation EMNLP 2024
PTDE: Personalized Training with Distilled Execution for Multi-Agent Reinforcement Learning IJCAI 2024