knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Task-Aware Prompt Gradient Projection for Parameter-Efficient Tuning Federated Class-Incremental Learning ICCV 2025

Confound from All Sides, Distill with Resilience: Multi-Objective Adversarial Paths to Zero-Shot Robustness ICCV 2025

You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025

LLM-assisted Entropy-based Adaptive Distillation for Unsupervised Fine-grained Visual Representation Learning ICCV 2025

MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling ICCV 2025

ResidualViT for Efficient Temporally Dense Video Encoding ICCV 2025

Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis ICCV 2025

KOEnsAttack: Towards Efficient Data-Free Black-Box Adversarial Attacks via Knowledge-Orthogonalized Substitute Ensembles ICCV 2025

DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization ICCV 2025

MTVHunter: Smart Contracts Vulnerability Detection Based on Multi-Teacher Knowledge Translation AAAI 2025

VRM: Knowledge Distillation via Virtual Relation Matching ICCV 2025

LiT: Delving into a Simple Linear Diffusion Transformer for Image Generation ICCV 2025

Exploiting Label Skewness for Spiking Neural Networks in Federated Learning IJCAI 2025

Rebalancing Multi-Label Class-Incremental Learning AAAI 2025

Knowledge Distillation with Refined Logits ICCV 2025

Connecting Giants: Synergistic Knowledge Transfer of Large Multimodal Models for Few-Shot Learning IJCAI 2025

KULFi Framework: Knowledge Utilization for Optimizing Large Language Models for Financial Causal Reasoning COLING 2025

Maintaining Fairness in Logit-based Knowledge Distillation for Class-Incremental Learning AAAI 2025

Bridging the Gap: Efficient Cross-Lingual NER in Low-Resource Financial Domain COLING 2025

Just KIDDIN’ : Knowledge Infusion and Distillation for Detection of INdecent Memes ACL 2025

SALE-MLP: Structure Aware Latent Embeddings for GNN to Graph-free MLP Distillation IJCAI 2025

What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025

Knowledge Distillation for Learned Image Compression ICCV 2025

Dual-Process Image Generation ICCV 2025

Learning Together to Perform Better: Teaching Small-Scale LLMs to Collaborate via Preferential Rationale Tuning ACL 2025