knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

SSR: Alignment-Aware Modality Connector for Speech Language Models ACL 2025

MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025

DaMoC: Efficiently Selecting the Optimal Large Language Model for Fine-tuning Domain Tasks Based on Data and Model Compression EMNLP 2025

Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation NAACL 2025

Cross-modal Multi-task Learning for Multimedia Event Extraction AAAI 2025

Adapting Multilingual Embedding Models to Historical Luxembourgish NAACL 2025

Distilling Many-Shot In-Context Learning into a Cheat Sheet EMNLP 2025

Encoder-Aware Sequence-Level Knowledge Distillation for Low-Resource Neural Machine Translation NAACL 2025

Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025

Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences ACL 2025

Improving Low-Resource Sequence Labeling with Knowledge Fusion and Contextual Label Explanations EMNLP 2025

UIPro: Unleashing Superior Interaction Capability For GUI Agents ICCV 2025

Aggregation Mechanism Based Graph Heterogeneous Networks Distillation IJCAI 2025

Towards the Law of Capacity Gap in Distilling Language Models ACL 2025

Warm Up Before You Train: Unlocking General Reasoning in Resource-Constrained Settings EMNLP 2025

A Self-Distillation Recipe for Neural Machine Translation ACL 2025

Multi-Sense Embeddings for Language Models and Knowledge Distillation ACL 2025

3DM: Distill, Dynamic Drop, and Merge for Debiasing Multi-modal Large Language Models ACL 2025

Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning ACL 2025

LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation ACL 2025

3D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation EMNLP 2025

Distilling A Universal Expert from Clustered Federated Learning IJCAI 2025

On the Generalization vs Fidelity Paradox in Knowledge Distillation ACL 2025

Learning Together to Perform Better: Teaching Small-Scale LLMs to Collaborate via Preferential Rationale Tuning ACL 2025

Motal: Unsupervised 3D Object Detection by Modality and Task-specific Knowledge Transfer ICCV 2025