conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024
Probabilistic Conformal Distillation for Enhancing Missing Modality Robustness NIPS 2024
Unified Insights: Harnessing Multi-modal Data for Phenotype Imputation via View Decoupling NIPS 2024
How Good is a Single Basin? AISTATS 2024
Revealing the Two Sides of Data Augmentation: An Asymmetric Distillation-based Win-Win Solution for Open-Set Recognition IJCAI 2024
Fine-Grained Distillation for Long Document Retrieval AAAI 2024
LEDetection: A Simple Framework for Semi-Supervised Few-Shot Object Detection AISTATS 2024
Video Event Extraction with Multi-View Interaction Knowledge Distillation AAAI 2024
Knowledge Distillation from Self-Supervised Representation Learning Model with Discrete Speech Units for Any-to-Any Streaming Voice Conversion INTERSPEECH 2024
DapperFL: Domain Adaptive Federated Learning with Model Fusion Pruning for Edge Devices NIPS 2024
From Coarse to Fine: A Distillation Method for Fine-Grained Emotion-Causal Span Pair Extraction in Conversation AAAI 2024
Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper EMNLP 2024
Rethinking Centered Kernel Alignment in Knowledge Distillation IJCAI 2024
Breaking Barriers of System Heterogeneity: Straggler-Tolerant Multimodal Federated Learning via Knowledge Distillation IJCAI 2024
Impossible Distillation for Paraphrasing and Summarization: How to Make High-quality Lemonade out of Small, Low-quality Model NAACL 2024
Efficiently Distilling LLMs for Edge Applications NAACL 2024
CAR-Transformer: Cross-Attention Reinforcement Transformer for Cross-Lingual Summarization AAAI 2024
Reviewing the Forgotten Classes for Domain Adaptation of Black-Box Predictors AAAI 2024
TIKP: Text-to-Image Knowledge Preservation for Continual Semantic Segmentation AAAI 2024
Continual Learning Optimizations for Auto-regressive Decoder of Multilingual ASR systems INTERSPEECH 2024
GSQA: An End-to-End Model for Generative Spoken Question Answering INTERSPEECH 2024
Aligning Vision Models with Human Aesthetics in Retrieval: Benchmarks and Algorithms NIPS 2024
D^4: Dataset Distillation via Disentangled Diffusion Model CVPR 2024
Plug-and-Play Diffusion Distillation CVPR 2024
Confidence Matters: Enhancing Medical Image Classification Through Uncertainty-Driven Contrastive Self-Distillation MICCAI 2024