← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Fine-Grained Knowledge Selection and Restoration for Non-exemplar Class Incremental Learning AAAI 2024
RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation AAAI 2024
CSL: Class-Agnostic Structure-Constrained Learning for Segmentation Including the Unseen AAAI 2024
Omnipotent Distillation with LLMs for Weakly-Supervised Natural Language Video Localization: When Divergence Meets Consistency AAAI 2024
Is a Large Language Model a Good Annotator for Event Extraction? AAAI 2024
LLM vs Small Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Model AAAI 2024
Three Heads Are Better than One: Improving Cross-Domain NER with Progressive Decomposed Network AAAI 2024
Turning Dust into Gold: Distilling Complex Reasoning Capabilities from LLMs by Leveraging Negative Data AAAI 2024
Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning AAAI 2024
Expediting Contrastive Language-Image Pretraining via Self-Distilled Encoders AAAI 2024
Hypercorrelation Evolution for Video Class-Incremental Learning AAAI 2024
Data Distribution Distilled Generative Model for Generalized Zero-Shot Recognition AAAI 2024
Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation AAAI 2024
Self-Distillation Regularized Connectionist Temporal Classification Loss for Text Recognition: A Simple Yet Effective Approach AAAI 2024
No Head Left Behind – Multi-Head Alignment Distillation for Transformers AAAI 2024
Let All Be Whitened: Multi-Teacher Distillation for Efficient Visual Retrieval AAAI 2024
Privileged Prior Information Distillation for Image Matting AAAI 2024
Cross-Modal Match for Language Conditioned 3D Object Grounding AAAI 2024
Rethinking Reverse Distillation for Multi-Modal Anomaly Detection AAAI 2024
Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation AAAI 2024
Amalgamating Multi-Task Models with Heterogeneous Architectures AAAI 2024
PTMQ: Post-training Multi-Bit Quantization of Neural Networks AAAI 2024
LSTKC: Long Short-Term Knowledge Consolidation for Lifelong Person Re-identification AAAI 2024
Exploring One-Shot Semi-supervised Federated Learning with Pre-trained Diffusion Models AAAI 2024
Collaborative Learning across Heterogeneous Systems with Pre-Trained Models AAAI 2024