knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

On Local Overfitting and Forgetting in Deep Neural Networks AAAI 2025

Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models ACL 2025

LATTE: Learning to Think with Vision Specialists EMNLP 2025

Distilling Structured Rationale from Large Language Models to Small Language Models for Abstractive Summarization AAAI 2025

FW-Merging: Scaling Model Merging with Frank-Wolfe Optimization ICCV 2025

Maximizing the Effectiveness of Larger BERT Models for Compression ACL 2025

2-in-1 Phishing Detection via Large LM Distillation and Small LM Perturbation (Student Abstract) AAAI 2025

Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models EMNLP 2025

Model-based Large Language Model Customization as Service EMNLP 2025

Towards Harmonized Uncertainty Estimation for Large Language Models ACL 2025

Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information EMNLP 2025

UnCo: Uncertainty-Driven Collaborative Framework of Large and Small Models for Grounded Multimodal NER EMNLP 2025

EMO: Embedding Model Distillation via Intra-Model Relation and Optimal Transport Alignments EMNLP 2025

Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation ACL 2025

AcT2I: Evaluating and Improving Action Depiction in Text-to-Image Models EMNLP 2025

Distilling Cross-Modal Knowledge into Domain-Specific Retrievers for Enhanced Industrial Document Understanding EMNLP 2025

SGC-Net: Stratified Granular Comparison Network for Open-Vocabulary HOI Detection CVPR 2025

Exploring Multimodal Relation Extraction of Hierarchical Tabular Data with Multi-task Learning ACL 2025

Inheriting Generalized Learngene for Efficient Knowledge Transfer across Multiple Tasks AAAI 2025

Adversarial Reconstruction Feedback for Robust Fine-grained Generalization ICCV 2025

3M-Game: Multi-Modal Multi-Task Multi-Teacher Learning for Game Event Detection (Student Abstract) AAAI 2025

Temporal reasoning for timeline summarisation in social media ACL 2025

Decoupled Distillation to Erase: A General Unlearning Method for Any Class-centric Tasks CVPR 2025

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture CVPR 2025

Aspect-Based Sentiment Analysis with Syntax-Opinion-Sentiment Reasoning Chain COLING 2025