knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Distilling Parallel Gradients for Fast ODE Solvers of Diffusion Models ICCV 2025

CycleDistill: Bootstrapping Machine Translation using LLMs with Cyclical Distillation IJCNLP 2025

Aspect-Based Sentiment Analysis with Syntax-Opinion-Sentiment Reasoning Chain COLING 2025

Talking Head Anime 4: Distillation for Real-Time Performance WACV 2025

Self-Evolution Knowledge Distillation for LLM-based Machine Translation COLING 2025

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process WACV 2025

Depth Any Event Stream: Enhancing Event-based Monocular Depth Estimation via Dense-to-Sparse Distillation ICCV 2025

DaMoC: Efficiently Selecting the Optimal Large Language Model for Fine-tuning Domain Tasks Based on Data and Model Compression EMNLP 2025

Adversarial Reconstruction Feedback for Robust Fine-grained Generalization ICCV 2025

Best Practices for Distilling Large Language Models into BERT for Web Search Ranking COLING 2025

Entire-Space Variational Information Exploitation for Post-Click Conversion Rate Prediction AAAI 2025

GARuD: Guided Alignment of Representations using Distillation for Ultra-Low-Resource Languages IJCNLP 2025

What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025

Fair Training with Zero Inputs AAAI 2025

Singular Value Scaling: Efficient Generative Model Compression via Pruned Weights Refinement AAAI 2025

Knowledge Distillation for Learned Image Compression ICCV 2025

MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling ICCV 2025

Boosting LLM Translation Skills without General Ability Loss via Rationale Distillation ACL 2025

The Green KNIGHT: Green Machine Translation with Knowledge-Distilled, Narrow, Inexpensive, Greedy, Hybrid Transformers EMNLP 2025

You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025

Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis ICCV 2025

AdaDARE-gamma: Balancing Stability and Plasticity in Multi-modal LLMs through Efficient Adaptation CVPR 2025

KOEnsAttack: Towards Efficient Data-Free Black-Box Adversarial Attacks via Knowledge-Orthogonalized Substitute Ensembles ICCV 2025

Dual-Process Image Generation ICCV 2025

Generating Questions Under Discussion with Reinforcement Learning using Ranking and Scoring for Reward and Evaluation AACL 2025