conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

SSR: Alignment-Aware Modality Connector for Speech Language Models ACL 2025
MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025
DaMoC: Efficiently Selecting the Optimal Large Language Model for Fine-tuning Domain Tasks Based on Data and Model Compression EMNLP 2025
Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation NAACL 2025
Cross-modal Multi-task Learning for Multimedia Event Extraction AAAI 2025
Adapting Multilingual Embedding Models to Historical Luxembourgish NAACL 2025
Distilling Many-Shot In-Context Learning into a Cheat Sheet EMNLP 2025
Encoder-Aware Sequence-Level Knowledge Distillation for Low-Resource Neural Machine Translation NAACL 2025
Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025
Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences ACL 2025
Improving Low-Resource Sequence Labeling with Knowledge Fusion and Contextual Label Explanations EMNLP 2025
CEMIL: Contextual Attention Based Efficient Weakly Supervised Approach for Histopathology Image Classification WACV 2025
Aggregation Mechanism Based Graph Heterogeneous Networks Distillation IJCAI 2025
Towards the Law of Capacity Gap in Distilling Language Models ACL 2025
Warm Up Before You Train: Unlocking General Reasoning in Resource-Constrained Settings EMNLP 2025
A Self-Distillation Recipe for Neural Machine Translation ACL 2025
Multi-Sense Embeddings for Language Models and Knowledge Distillation ACL 2025
3DM: Distill, Dynamic Drop, and Merge for Debiasing Multi-modal Large Language Models ACL 2025
Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning ACL 2025
LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation ACL 2025
3D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation EMNLP 2025
Distilling A Universal Expert from Clustered Federated Learning IJCAI 2025
On the Generalization vs Fidelity Paradox in Knowledge Distillation ACL 2025
Learning Together to Perform Better: Teaching Small-Scale LLMs to Collaborate via Preferential Rationale Tuning ACL 2025
Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models ACL 2025