conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Improved Techniques for Quantizing Deep Networks With Adaptive Bit-Widths WACV 2024
Hypernetwork-Assisted Parameter-Efficient Fine-Tuning with Meta-Knowledge Distillation for Domain Knowledge Disentanglement NAACL 2024
AP-Adapter: Improving Generalization of Automatic Prompts on Unseen Text-to-Image Diffusion Models NIPS 2024
TransAgent: Transfer Vision-Language Foundation Models with Heterogeneous Agent Collaboration NIPS 2024
Voxel Proposal Network via Multi-Frame Knowledge Distillation for Semantic Scene Completion NIPS 2024
One-shot Federated Learning via Synthetic Distiller-Distillate Communication NIPS 2024
CIFD: Controlled Information Flow to Enhance Knowledge Distillation NIPS 2024
FAST: A Dual-tier Few-Shot Learning Paradigm for Whole Slide Image Classification NIPS 2024
Geometry Awakening: Cross-Geometry Learning Exhibits Superiority over Individual Structures NIPS 2024
S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning NIPS 2024
FedGMKD: An Efficient Prototype Federated Learning Framework through Knowledge Distillation and Discrepancy-Aware Aggregation NIPS 2024
Unlocking the Potential of Global Human Expertise NIPS 2024
SimVG: A Simple Framework for Visual Grounding with Decoupled Multi-modal Fusion NIPS 2024
EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models NIPS 2024
Cross-Device Collaborative Test-Time Adaptation NIPS 2024
VeXKD: The Versatile Integration of Cross-Modal Fusion and Knowledge Distillation for 3D Perception NIPS 2024
Model LEGO: Creating Models Like Disassembling and Assembling Building Blocks NIPS 2024
Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge Integration NIPS 2024
Fine-grained Image-to-LiDAR Contrastive Distillation with Visual Foundation Models NIPS 2024
DDK: Distilling Domain Knowledge for Efficient Large Language Models NIPS 2024
Adversarial Moment-Matching Distillation of Large Language Models NIPS 2024
A teacher-teacher framework for clinical language representation learning NIPS 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models NIPS 2024
Search for Efficient Large Language Models NIPS 2024
On the Surprising Effectiveness of Attention Transfer for Vision Transformers NIPS 2024