conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Variational Distillation of Diffusion Policies into Mixture of Experts NIPS 2024
Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitate NIPS 2024
Breaking ReLU Barrier: Generalized MoEfication for Dense Pretrained Models EMNLP 2024
KNN-Instruct: Automatic Instruction Construction with K Nearest Neighbor Deduction EMNLP 2024
LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models EMNLP 2024
SARCAT: Generative Span-Act Guided Response Generation using Copy-enhanced Target Augmentation EMNLP 2024
Pioneering Reliable Assessment in Text-to-Image Knowledge Editing: Leveraging a Fine-Grained Dataset and an Innovative Criterion EMNLP 2024
ELAD: Explanation-Guided Large Language Models Active Distillation ACL 2024
On Instruction-Finetuning Neural Machine Translation Models EMNLP 2024
Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation EMNLP 2024
Local-Global Multi-Modal Distillation for Weakly-Supervised Temporal Video Grounding AAAI 2024
Simple Image-Level Classification Improves Open-Vocabulary Object Detection AAAI 2024
Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Language AAAI 2024
HUNTER: Unsupervised Human-centric 3D Detection via Transferring Knowledge from Synthetic Instances to Real Scenes CVPR 2024
Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior CVPR 2024
Small Scale Data-Free Knowledge Distillation CVPR 2024
Model LEGO: Creating Models Like Disassembling and Assembling Building Blocks NIPS 2024
Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge Integration NIPS 2024
Fine-grained Image-to-LiDAR Contrastive Distillation with Visual Foundation Models NIPS 2024
DDK: Distilling Domain Knowledge for Efficient Large Language Models NIPS 2024
Adversarial Moment-Matching Distillation of Large Language Models NIPS 2024
A teacher-teacher framework for clinical language representation learning NIPS 2024
Fine-Grained Knowledge Selection and Restoration for Non-exemplar Class Incremental Learning AAAI 2024
Zero-Shot Aerial Object Detection with Visual Description Regularization AAAI 2024
Segment beyond View: Handling Partially Missing Modality for Audio-Visual Semantic Segmentation AAAI 2024