← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Exploring Chain-of-Thought for Multi-modal Metaphor Detection ACL 2024
COMBHelper: A Neural Approach to Reduce Search Space for Graph Combinatorial Problems AAAI 2024
Some Like It Small: Czech Semantic Embedding Models for Industry Applications AAAI 2024
Federated Learning via Input-Output Collaborative Distillation AAAI 2024
Layer Attack Unlearning: Fast and Accurate Machine Unlearning via Layer Level Attack and Knowledge Distillation AAAI 2024
Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024
Probabilistic Conformal Distillation for Enhancing Missing Modality Robustness NIPS 2024
Unified Insights: Harnessing Multi-modal Data for Phenotype Imputation via View Decoupling NIPS 2024
How Good is a Single Basin? AISTATS 2024
Revealing the Two Sides of Data Augmentation: An Asymmetric Distillation-based Win-Win Solution for Open-Set Recognition IJCAI 2024
Fine-Grained Distillation for Long Document Retrieval AAAI 2024
LEDetection: A Simple Framework for Semi-Supervised Few-Shot Object Detection AISTATS 2024
Video Event Extraction with Multi-View Interaction Knowledge Distillation AAAI 2024
Knowledge Distillation from Self-Supervised Representation Learning Model with Discrete Speech Units for Any-to-Any Streaming Voice Conversion INTERSPEECH 2024
DapperFL: Domain Adaptive Federated Learning with Model Fusion Pruning for Edge Devices NIPS 2024
From Coarse to Fine: A Distillation Method for Fine-Grained Emotion-Causal Span Pair Extraction in Conversation AAAI 2024
Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper EMNLP 2024
Rethinking Centered Kernel Alignment in Knowledge Distillation IJCAI 2024
Breaking Barriers of System Heterogeneity: Straggler-Tolerant Multimodal Federated Learning via Knowledge Distillation IJCAI 2024
Impossible Distillation for Paraphrasing and Summarization: How to Make High-quality Lemonade out of Small, Low-quality Model NAACL 2024
Efficiently Distilling LLMs for Edge Applications NAACL 2024
CAR-Transformer: Cross-Attention Reinforcement Transformer for Cross-Lingual Summarization AAAI 2024
Reviewing the Forgotten Classes for Domain Adaptation of Black-Box Predictors AAAI 2024
TIKP: Text-to-Image Knowledge Preservation for Continual Semantic Segmentation AAAI 2024
Continual Learning Optimizations for Auto-regressive Decoder of Multilingual ASR systems INTERSPEECH 2024