conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025
Adapting Multilingual Embedding Models to Historical Luxembourgish NAACL 2025
Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation NAACL 2025
Cross-modal Multi-task Learning for Multimedia Event Extraction AAAI 2025
ScaleOT: Privacy-utility-scalable Offsite-tuning with Dynamic LayerReplace and Selective Rank Compression AAAI 2025
MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025
Beyond the Mode: Sequence-Level Distillation of Multilingual Translation Models for Low-Resource Language Pairs NAACL 2025
SSR: Alignment-Aware Modality Connector for Speech Language Models ACL 2025
Lightweight Contenders: Navigating Semi-Supervised Text Mining through Peer Collaboration and Self Transcendence NAACL 2025
Efficient Speech Translation through Model Compression and Knowledge Distillation ACL 2025
Tackling Long-Tailed Data Challenges in Spiking Neural Networks via Heterogeneous Knowledge Distillation IJCAI 2025
A Cross-Modal Densely Guided Knowledge Distillation Based on Modality Rebalancing Strategy for Enhanced Unimodal Emotion Recognition IJCAI 2025
Filling Memory Gaps: Enhancing Continual Semantic Parsing via SQL Syntax Variance-Guided LLMs Without Real Data Replay AAAI 2025
Counterfactual Knowledge Maintenance for Unsupervised Domain Adaptation IJCAI 2025
Huatuo-26M, a Large-scale Chinese Medical QA Dataset NAACL 2025
SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025
Speed Without Sacrifice: Fine-Tuning Language Models with Medusa and Knowledge Distillation in Travel Applications ACL 2025
Investigating the Transferability of Code Repair for Low-Resource Programming Languages NAACL 2025
Basic Reading Distillation ACL 2025
Shy-hunyuan-MT at WMT25 General Machine Translation Shared Task EMNLP 2025
Egocentric Object-Interaction Anticipation with Retentive and Predictive Learning IJCAI 2025
The Gemma Sutras: Fine-Tuning Gemma 3 for Sanskrit Sandhi Splitting EMNLP 2025
DRAMA: Diverse Augmentation from Large Language Models to Smaller Dense Retrievers ACL 2025
Findings of the WMT 2025 Shared Task on Model Compression: Early Insights on Compressing LLMs for Machine Translation EMNLP 2025
Vicomtech@WMT 2025: Evolutionary Model Compression for Machine Translation EMNLP 2025