conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

CR-FIQA: Face Image Quality Assessment by Learning Sample Relative Classifiability CVPR 2023
MEDIC: Remove Model Backdoors via Importance Driven Cloning CVPR 2023
Task Residual for Tuning Vision-Language Models CVPR 2023
BoxTeacher: Exploring High-Quality Pseudo Labels for Weakly Supervised Instance Segmentation CVPR 2023
Batch Model Consolidation: A Multi-Task Model Consolidation Framework CVPR 2023
Decoupled Multimodal Distilling for Emotion Recognition CVPR 2023
Local 3D Editing via 3D Distillation of CLIP Knowledge CVPR 2023
Federated Incremental Semantic Segmentation CVPR 2023
CombLM: Adapting Black-Box Language Models through Small Fine-Tuned Models EMNLP 2023
Lion: Adversarial Distillation of Proprietary Large Language Models EMNLP 2023
DisCo: Distilled Student Models Co-training for Semi-supervised Text Mining EMNLP 2023
Efficient Transformer Knowledge Distillation: A Performance Review EMNLP 2023
Parameter-efficient Tuning for Large Language Model without Calculating Its Gradients EMNLP 2023
Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extraction EMNLP 2023
Harnessing Black-Box Control to Boost Commonsense in LM’s Generation EMNLP 2023
Segment Any Point Cloud Sequences by Distilling Vision Foundation Models NIPS 2023
QLoRA: Efficient Finetuning of Quantized LLMs NIPS 2023
Knowledge Distillation for High Dimensional Search Index NIPS 2023
Revisiting Adversarial Robustness Distillation from the Perspective of Robust Fairness NIPS 2023
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models NIPS 2023
Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale NIPS 2023
Slimmed Asymmetrical Contrastive Learning and Cross Distillation for Lightweight Model Training NIPS 2023
One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation NIPS 2023
Weakly Supervised 3D Open-vocabulary Segmentation NIPS 2023
On student-teacher deviations in distillation: does it pay to disobey? NIPS 2023