conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extraction EMNLP 2023
Harnessing Black-Box Control to Boost Commonsense in LM’s Generation EMNLP 2023
Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval CVPR 2023
DiGA: Distil To Generalize and Then Adapt for Domain Adaptive Semantic Segmentation CVPR 2023
Segment Any Point Cloud Sequences by Distilling Vision Foundation Models NIPS 2023
QLoRA: Efficient Finetuning of Quantized LLMs NIPS 2023
Knowledge Distillation for High Dimensional Search Index NIPS 2023
Revisiting Adversarial Robustness Distillation from the Perspective of Robust Fairness NIPS 2023
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models NIPS 2023
Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale NIPS 2023
Slimmed Asymmetrical Contrastive Learning and Cross Distillation for Lightweight Model Training NIPS 2023
One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation NIPS 2023
The Unreasonable Effectiveness of Large Language-Vision Models for Source-Free Video Domain Adaptation ICCV 2023
Weakly Supervised 3D Open-vocabulary Segmentation NIPS 2023
On student-teacher deviations in distillation: does it pay to disobey? NIPS 2023
What Knowledge Gets Distilled in Knowledge Distillation? NIPS 2023
Towards Efficient Pre-Trained Language Model via Feature Correlation Distillation NIPS 2023
Learning From Biased Soft Labels NIPS 2023
End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillation AAAI 2023
Learning To Retain While Acquiring: Combating Distribution-Shift in Adversarial Data-Free Knowledge Distillation CVPR 2023
Data-Free Knowledge Distillation via Feature Exchange and Activation Region Constraint CVPR 2023
DyLiN: Making Light Field Networks Dynamic CVPR 2023
HOICLIP: Efficient Knowledge Transfer for HOI Detection With Vision-Language Models CVPR 2023
Open-Set Fine-Grained Retrieval via Prompting Vision-Language Evaluator CVPR 2023
Multi-Level Logit Distillation CVPR 2023