← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

A Compact Model for Mathematics Problem Representations Distilled from BERT AAAI 2025
Curriculum Hierarchical Knowledge Distillation for Bias-Free Survival Prediction IJCAI 2025
CoLA-Former: Graph Transformer Using Communal Linear Attention for Lightweight Sequential Recommendation IJCAI 2025
Self-Evolution Knowledge Distillation for LLM-based Machine Translation COLING 2025
SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation EMNLP 2025
DPMamba: Distillation Prompt Mamba for Multimodal Remote Sensing Image Classification with Missing Modalities IJCAI 2025
Multi-modal Anchor Gated Transformer with Knowledge Distillation for Emotion Recognition in Conversation IJCAI 2025
Soft Separation and Distillation: Toward Global Uniformity in Federated Unsupervised Learning ICCV 2025
Targeted Distillation for Sentiment Analysis EMNLP 2025
Alignment with Fill-In-the-Middle for Enhancing Code Generation EMNLP 2025
TeEFusion: Blending Text Embeddings to Distill Classifier-Free Guidance ICCV 2025
CD^2: Constrained Dataset Distillation for Few-Shot Class-Incremental Learning IJCAI 2025
Aspect-Based Sentiment Analysis with Syntax-Opinion-Sentiment Reasoning Chain COLING 2025
Embedding Domain Knowledge for Large Language Models via Reinforcement Learning from Augmented Generation EMNLP 2025
Weather Foundation Model Enhanced Decentralized Photovoltaic Power Forecasting Through Spatio-temporal Knowledge Distillation IJCAI 2025
Shy-hunyuan-MT at WMT25 General Machine Translation Shared Task EMNLP 2025
Large Language Model Meets Graph Neural Network in Knowledge Distillation AAAI 2025
MemDistill: Distilling LiDAR Knowledge into Memory for Camera-Only 3D Object Detection ICCV 2025
Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models AAAI 2025
Pruning Large Language Models with Semi-Structural Adaptive Sparse Training AAAI 2025
Exploring Model Editing for LLM-based Aspect-Based Sentiment Classification AAAI 2025
BayesKD: Bayesian Knowledge Distillation for Compact LLMs in Constrained Fine-tuning Scenarios ACL 2025
ClusComp: A Simple Paradigm for Model Compression and Efficient Finetuning ACL 2025
Prototypical Replay with Old-class Focusing Knowledge Distillation for Incremental Named Entity Recognition AAAI 2025
Mamba-Adaptor: State Space Model Adaptor for Visual Recognition CVPR 2025