← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

SSVQ: Unleashing the Potential of Vector Quantization with Sign-Splitting ICCV 2025
MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling ICCV 2025
Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis ICCV 2025
A Diverse and Effective Retrieval-Based Debt Collection System with Expert Knowledge NAACL 2025
uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimes NAACL 2025
DisComp: A Two-Stage Prompt Optimization Framework Combining Task-Agnostic and Task-Aware Compression NAACL 2025
It Is Not Only the Negative that Deserves Attention! Understanding, Generation & Evaluation of (Positive) Moderation NAACL 2025
VIT-Pro: Visual Instruction Tuning for Product Images NAACL 2025
KULFi Framework: Knowledge Utilization for Optimizing Large Language Models for Financial Causal Reasoning COLING 2025
Knowledge Distillation for Learned Image Compression ICCV 2025
Distill-C: Enhanced NL2SQL via Distilled Customization with LLMs NAACL 2025
Text2Sql: Pure Fine-Tuning and Pure Knowledge Distillation NAACL 2025
Can’t Hide Behind the API: Stealing Black-Box Commercial Embedding Models NAACL 2025
Improving SAM for Camouflaged Object Detection via Dual Stream Adapters ICCV 2025
Bridging the Gap: Efficient Cross-Lingual NER in Low-Resource Financial Domain COLING 2025
What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025
MLAS-LoRA: Language-Aware Parameters Detection and LoRA-Based Knowledge Transfer for Multilingual Machine Translation ACL 2025
Extracting General-use Transformers for Low-resource Languages via Knowledge Distillation COLING 2025
Implementing Retrieval Augmented Generation Technique on Unstructured and Structured Data Sources in a Call Center of a Large Financial Institution NAACL 2025
Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs ACL 2025
LightBSR: Towards Lightweight Blind Super-Resolution via Discriminative Implicit Degradation Representation Learning ICCV 2025
Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data NAACL 2025
RTSM: Knowledge Distillation with Diverse Signals for Efficient Real-Time Semantic Matching in E-Commerce NAACL 2025
Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models ACL 2025
DoMIX: An Efficient Framework for Exploiting Domain Knowledge in Fine-Tuning ACL 2025