conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis WACV 2024
Towards Domain-Aware Knowledge Distillation for Continual Model Generalization WACV 2024
Kaizen: Practical Self-Supervised Continual Learning With Continual Fine-Tuning WACV 2024
Teaching Small Language Models to Reason for Knowledge-Intensive Multi-Hop Question Answering ACL 2024
DistillMIKE: Editing Distillation of Massive In-Context Knowledge Editing in Large Language Models ACL 2024
Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning ACL 2024
FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentation WACV 2024
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages ACL 2024
Continual Learning with Semi-supervised Contrastive Distillation for Incremental Neural Machine Translation ACL 2024
FastAST: Accelerating Audio Spectrogram Transformer via Token Merging and Cross-Model Knowledge Distillation INTERSPEECH 2024
VkD: Improving Knowledge Distillation using Orthogonal Projections CVPR 2024
CoDi: Conditional Diffusion Distillation for Higher-Fidelity and Faster Image Generation CVPR 2024
MoPE-CLIP: Structured Pruning for Efficient Vision-Language Models with Module-wise Pruning Error Metric CVPR 2024
Asymmetric Masked Distillation for Pre-Training Small Foundation Models CVPR 2024
SelfCodeAlign: Self-Alignment for Code Generation NIPS 2024
Efficient Multi-task LLM Quantization and Serving for Multiple LoRA Adapters NIPS 2024
Federated Model Heterogeneous Matryoshka Representation Learning NIPS 2024
Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE NIPS 2024
OD-DETR: Online Distillation for Stabilizing Training of Detection Transformer IJCAI 2024
SHAP-EDITOR: Instruction-Guided Latent 3D Editing in Seconds CVPR 2024
ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning CVPR 2024
Benchmarking Diffusion Models for Machine Translation EACL 2024
Minimal Distillation Schedule for Extreme Language Model Compression EACL 2024
Cross-model Control: Improving Multiple Large Language Models in One-time Training NIPS 2024
EnOF-SNN: Training Accurate Spiking Neural Networks via Enhancing the Output Feature NIPS 2024