conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Interactive Multi-fidelity Learning for Cost-effective Adaptation of Language Model with Sparse Human Supervision NIPS 2023
Exploring the Relative Value of Collaborative Optimisation Pathways (Student Abstract) AAAI 2023
Learning to Imagine: Distillation-Based Interactive Context Exploitation for Dialogue State Tracking AAAI 2023
MaskBooster: End-to-End Self-Training for Sparsely Supervised Instance Segmentation AAAI 2023
Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023
Semi-attention Partition for Occluded Person Re-identification AAAI 2023
Continual Detection Transformer for Incremental Object Detection CVPR 2023
TimeBalance: Temporally-Invariant and Temporally-Distinctive Video Representations for Semi-Supervised Action Recognition CVPR 2023
Weak-Shot Object Detection Through Mutual Knowledge Transfer CVPR 2023
FeatureNeRF: Learning Generalizable NeRFs by Distilling Foundation Models ICCV 2023
Self-Decoupling and Ensemble Distillation for Efficient Segmentation AAAI 2023
On the Fairness Impacts of Private Ensembles Models IJCAI 2023
Model Conversion via Differentially Private Data-Free Distillation IJCAI 2023
Learning Human-Human Interactions in Images from Weak Textual Supervision ICCV 2023
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation ICCV 2023
MEGA: Multimodal Alignment Aggregation and Distillation For Cinematic Video Segmentation ICCV 2023
mCLIP: Multilingual CLIP via Cross-lingual Transfer ACL 2023
Self-Distillation into Self-Attention Heads for Improving Transformer-based End-to-End Neural Speaker Diarization INTERSPEECH 2023
Regularized Mask Tuning: Uncovering Hidden Knowledge in Pre-Trained Vision-Language Models ICCV 2023
A Study on the Efficiency and Generalization of Light Hybrid Retrievers ACL 2023
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model ACL 2023
Rethinking the Role of Pre-Trained Networks in Source-Free Domain Adaptation ICCV 2023
Debiased Fine-Tuning for Vision-Language Models by Prompt Regularization AAAI 2023
Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learning AAAI 2023
FedET: A Communication-Efficient Federated Class-Incremental Learning Framework Based on Enhanced Transformer IJCAI 2023