conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

RECALL: REpresentation-aligned Catastrophic-forgetting ALLeviation via Hierarchical Model Merging EMNLP 2025
ThinkSLM: Towards Reasoning in Small Language Models EMNLP 2025
Dropout Connects Transformers and CNNs: Transfer General Knowledge for Knowledge Distillation WACV 2025
Multi-modal Anchor Gated Transformer with Knowledge Distillation for Emotion Recognition in Conversation IJCAI 2025
In-context Learning Demonstration Generation with Text Distillation IJCAI 2025
Model-based Large Language Model Customization as Service EMNLP 2025
Learning Together to Perform Better: Teaching Small-Scale LLMs to Collaborate via Preferential Rationale Tuning ACL 2025
Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information EMNLP 2025
Distilling A Universal Expert from Clustered Federated Learning IJCAI 2025
LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation ACL 2025
EMO: Embedding Model Distillation via Intra-Model Relation and Optimal Transport Alignments EMNLP 2025
DPMamba: Distillation Prompt Mamba for Multimodal Remote Sensing Image Classification with Missing Modalities IJCAI 2025
UnCo: Uncertainty-Driven Collaborative Framework of Large and Small Models for Grounded Multimodal NER EMNLP 2025
A Self-Distillation Recipe for Neural Machine Translation ACL 2025
Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis ICCV 2025
Towards the Law of Capacity Gap in Distilling Language Models ACL 2025
Adaptive Dataset Quantization AAAI 2025
Aggregation Mechanism Based Graph Heterogeneous Networks Distillation IJCAI 2025
Improving Pre-trained Language Models with Knowledge Enhancement and Filtering Framework NAACL 2025
Egocentric Object-Interaction Anticipation with Retentive and Predictive Learning IJCAI 2025
Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences ACL 2025
Encoder-Aware Sequence-Level Knowledge Distillation for Low-Resource Neural Machine Translation NAACL 2025
Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025
Adapting Multilingual Embedding Models to Historical Luxembourgish NAACL 2025
Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation NAACL 2025