knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentation WACV 2024

Guided Distillation for Semi-Supervised Instance Segmentation WACV 2024

BPKD: Boundary Privileged Knowledge Distillation for Semantic Segmentation WACV 2024

Rethinking Knowledge Distillation With Raw Features for Semantic Segmentation WACV 2024

Asymmetric Image Retrieval With Cross Model Compatible Ensembles WACV 2024

Efficient Feature Distillation for Zero-Shot Annotation Object Detection WACV 2024

Alleviating Foreground Sparsity for Semi-Supervised Monocular 3D Object Detection WACV 2024

Offline-to-Online Knowledge Distillation for Video Instance Segmentation WACV 2024

Gradient-Guided Knowledge Distillation for Object Detectors WACV 2024

FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions WACV 2024

Can Public Large Language Models Help Private Cross-device Federated Learning? NAACL 2024

Cross-transfer Knowledge between Speech and Text Encoders to Evaluate Customer Satisfaction INTERSPEECH 2024

Enhanced Feature Learning with Normalized Knowledge Distillation for Audio Tagging INTERSPEECH 2024

DivTOD: Unleashing the Power of LLMs for Diversifying Task-Oriented Dialogue Representations NAACL 2024

Transformer as Linear Expansion of Learngene AAAI 2024

MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AAAI 2024

MCAD: Multi-teacher Cross-modal Alignment Distillation for efficient image-text retrieval NAACL 2024

Progressively Knowledge Distillation via Re-parameterizing Diffusion Reverse Process AAAI 2024

StyleGAN-Fusion: Diffusion Guided Domain Adaptation of Image Generators WACV 2024

FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices With a Simple Super-Resolution Pipeline WACV 2024

Evolve: Enhancing Unsupervised Continual Learning With Multiple Experts WACV 2024

GTP-ViT: Efficient Vision Transformers via Graph-Based Token Propagation WACV 2024

Discrepancy and Uncertainty Aware Denoising Knowledge Distillation for Zero-Shot Cross-Lingual Named Entity Recognition AAAI 2024

EPSD: Early Pruning with Self-Distillation for Efficient Model Compression AAAI 2024

ShareBERT: Embeddings Are Capable of Learning Hidden Layers AAAI 2024