knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Closed-Loop Transfer for Weakly-supervised Affordance Grounding ICCV 2025

Implicit Word Reordering with Knowledge Distillation for Cross-Lingual Dependency Parsing AAAI 2025

Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models ACL 2025

Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesis ICCV 2025

Dream-to-Recon: Monocular 3D Reconstruction with Diffusion-Depth Distillation from Single Images ICCV 2025

Controlling Equational Reasoning in Large Language Models with Prompt Interventions AAAI 2025

Multi-Perspective Consolidation Enhanced Cognitive Diagnosis via Conditional Diffusion Model AAAI 2025

Gradient Decomposition and Alignment for Incremental Object Detection ICCV 2025

G2D: Boosting Multimodal Learning with Gradient-Guided Distillation ICCV 2025

Large Language Model as a Teacher for Zero-shot Tagging at Extreme Scales COLING 2025

MLAS-LoRA: Language-Aware Parameters Detection and LoRA-Based Knowledge Transfer for Multilingual Machine Translation ACL 2025

In-context Learning Demonstration Generation with Text Distillation IJCAI 2025

Chain-of-Specificity: Enhancing Task-Specific Constraint Adherence in Large Language Models COLING 2025

Enhancing Knowledge Distillation of Large Language Models through Efficient Multi-Modal Distribution Alignment COLING 2025

Factual Dialogue Summarization via Learning from Large Language Models COLING 2025

Towards Faithful Multi-step Reasoning through Fine-Grained Causal-aware Attribution Reasoning Distillation COLING 2025

Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation? ACL 2025

Simulating Dual-Process Thinking in Dialogue Topic Shift Detection COLING 2025

What Makes a Good Dataset for Knowledge Distillation? CVPR 2025

WAVE: Weight Templates for Adaptive Initialization of Variable-sized Models CVPR 2025

SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models COLING 2025

Aspect-Based Sentiment Analysis with Syntax-Opinion-Sentiment Reasoning Chain COLING 2025

Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs ACL 2025

Scaffold-BPE: Enhancing Byte Pair Encoding for Large Language Models with Simple and Effective Scaffold Token Removal AAAI 2025

Latte: Transfering LLMs' Latent-level Knowledge for Few-shot Tabular Learning IJCAI 2025