conftrace_

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model EMNLP 2023

FedID: Federated Interactive Distillation for Large-Scale Pretraining Language Models EMNLP 2023

Generating Data for Symbolic Language with Large Language Models EMNLP 2023

CaseEncoder: A Knowledge-enhanced Pre-trained Model for Legal Case Encoding EMNLP 2023

Personalized Distillation: Empowering Open-Sourced LLMs with Adaptive Learning for Code Generation EMNLP 2023

Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents EMNLP 2023

Distilling Vision-Language Pre-Training To Collaborate With Weakly-Supervised Temporal Action Localization CVPR 2023

DaFKD: Domain-Aware Federated Knowledge Distillation CVPR 2023

MMANet: Margin-Aware Distillation and Modality-Aware Regularization for Incomplete Multimodal Learning CVPR 2023

Preserving Linear Separability in Continual Learning by Backward Feature Projection CVPR 2023

3DAvatarGAN: Bridging Domains for Personalized Editable Avatars CVPR 2023

Diffusion-Based Probabilistic Uncertainty Estimation for Active Domain Adaptation NIPS 2023

Accelerating Molecular Graph Neural Networks via Knowledge Distillation NIPS 2023

Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models NIPS 2023

Metis: Understanding and Enhancing In-Network Regular Expressions NIPS 2023

Heterogeneous-Branch Collaborative Learning for Dialogue Generation AAAI 2023

Should Under-parameterized Student Networks Copy or Average Teacher Weights? NIPS 2023

CR-FIQA: Face Image Quality Assessment by Learning Sample Relative Classifiability CVPR 2023

MEDIC: Remove Model Backdoors via Importance Driven Cloning CVPR 2023

Task Residual for Tuning Vision-Language Models CVPR 2023

BoxTeacher: Exploring High-Quality Pseudo Labels for Weakly Supervised Instance Segmentation CVPR 2023

Batch Model Consolidation: A Multi-Task Model Consolidation Framework CVPR 2023

Decoupled Multimodal Distilling for Emotion Recognition CVPR 2023

Local 3D Editing via 3D Distillation of CLIP Knowledge CVPR 2023

Federated Incremental Semantic Segmentation CVPR 2023