knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

DRAMA: Diverse Augmentation from Large Language Models to Smaller Dense Retrievers ACL 2025

uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimes NAACL 2025

MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling ICCV 2025

Robust Utility-Preserving Text Anonymization Based on Large Language Models ACL 2025

Task-Aware Prompt Gradient Projection for Parameter-Efficient Tuning Federated Class-Incremental Learning ICCV 2025

It Is Not Only the Negative that Deserves Attention! Understanding, Generation & Evaluation of (Positive) Moderation NAACL 2025

A Diverse and Effective Retrieval-Based Debt Collection System with Expert Knowledge NAACL 2025

BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions CVPR 2025

PIPER: Benchmarking and Prompting Event Reasoning Boundary of LLMs via Debiasing-Distillation Enhanced Tuning ACL 2025

BiomedCoOp: Learning to Prompt for Biomedical Vision-Language Models CVPR 2025

Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment CVPR 2025

Temporal reasoning for timeline summarisation in social media ACL 2025

Distill-C: Enhanced NL2SQL via Distilled Customization with LLMs NAACL 2025

DisComp: A Two-Stage Prompt Optimization Framework Combining Task-Agnostic and Task-Aware Compression NAACL 2025

You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025

Exploring Multimodal Relation Extraction of Hierarchical Tabular Data with Multi-task Learning ACL 2025

KOEnsAttack: Towards Efficient Data-Free Black-Box Adversarial Attacks via Knowledge-Orthogonalized Substitute Ensembles ICCV 2025

Distilling Cross-Modal Knowledge into Domain-Specific Retrievers for Enhanced Industrial Document Understanding EMNLP 2025

Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation ACL 2025

Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models EMNLP 2025

Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data NAACL 2025

Can’t Hide Behind the API: Stealing Black-Box Commercial Embedding Models NAACL 2025

Efficient Dynamic Ensembling for Multiple LLM Experts IJCAI 2025

Zero-shot Federated Unlearning via Transforming from Data-Dependent to Personalized Model-Centric IJCAI 2025

EditAR: Unified Conditional Generation with Autoregressive Models CVPR 2025