knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

DCA: Dividing and Conquering Amnesia in Incremental Object Detection AAAI 2025

Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration AAAI 2025

Sim4Rec: Data-Free Model Extraction Attack on Sequential Recommendation AAAI 2025

ConDo: Continual Domain Expansion for Absolute Pose Regression AAAI 2025

MTVHunter: Smart Contracts Vulnerability Detection Based on Multi-Teacher Knowledge Translation AAAI 2025

Connecting Giants: Synergistic Knowledge Transfer of Large Multimodal Models for Few-Shot Learning IJCAI 2025

Maintaining Fairness in Logit-based Knowledge Distillation for Class-Incremental Learning AAAI 2025

Adaptive Dual Guidance Knowledge Distillation AAAI 2025

TinySAM: Pushing the Envelope for Efficient Segment Anything Model AAAI 2025

CLIP-CID: Efficient CLIP Distillation via Cluster-Instance Discrimination AAAI 2025

Neural Collapse Inspired Knowledge Distillation AAAI 2025

LAGD: Local Topological-Alignment and Global Semantic-Deconstruction for Incremental 3D Semantic Segmentation AAAI 2025

All You Need in Knowledge Distillation Is a Tailored Coordinate System AAAI 2025

DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts ACL 2025

Powerformer: Efficient and High-Accuracy Privacy-Preserving Language Model with Homomorphic Encryption ACL 2025

Procedure Knowledge Decoupled Distillation Strategy for Procedure Planning in Instructional Videos AAAI 2025

Both Supply and Precision: Sample Debias and Ranking Consistency Joint Learning for Large Scale Pre-Ranking System AAAI 2025

Henry at BEA 2025 Shared Task: Improving AI Tutor’s Guidance Evaluation Through Context-Aware Distillation ACL 2025

Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents ACL 2025

From Teacher to Student: Tracking Memorization Through Model Distillation ACL 2025

Hybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligence ACL 2025

DUTIR at SemEval-2025 Task 10: A Large Language Model-based Approach for Entity Framing in Online News ACL 2025

Dianchi at SemEval-2025 Task 11: Multilabel Emotion Recognition via Orthogonal Knowledge Distillation ACL 2025

Howard University-AI4PC at SemEval-2025 Task 4: Unlearning Sensitive Content From Large Language Models Using Finetuning and Distillation for Selective Knowledge Removal ACL 2025

KULFi Framework: Knowledge Utilization for Optimizing Large Language Models for Financial Causal Reasoning COLING 2025