conftrace_

student model

107 papers

Explore in graph

Co-occurring keywords

knowledge distillation (3725) model compression (3302) teacher model (53) large language model (13587) language model (4599) transfer learning (5449) neural network (6616) representation learning (6206) text classification (6793) relational knowledge (26)

Papers

ASKD: Reinforcement Learning-Style Knowledge Distillation with Quality-Adaptive Skewness AAAI 2026
Balanced Knowledge Distillation for Large Language Models with Mix-of-Experts AAAI 2026
Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation ACL 2026
C2R-KD: Complex to Real Knowledge Distillation (Student Abstract) AAAI 2026
Incentivizing Strong Reasoning from Weak Supervision EACL 2026
LLM-Oriented Token-Adaptive Knowledge Distillation AAAI 2026
iCD: An Implicit Clustering Distillation Method for Structural Information Mining (Student Abstract) AAAI 2026
Stratos: An End-to-End Distillation Pipeline for Customized LLMs Under Distributed Cloud Environments AAAI 2026
Pareto-Based Heterogeneous Knowledge Distillation for MLPs on Graphs AAAI 2026
SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025
From Teacher to Student: Tracking Memorization Through Model Distillation ACL 2025
Enhancing Knowledge Distillation of Large Language Models through Efficient Multi-Modal Distribution Alignment COLING 2025
Debate, Reflect, and Distill: Multi-Agent Feedback with Tree-Structured Preference Optimization for Efficient Language Model Enhancement ACL 2025
What Makes a Good Dataset for Knowledge Distillation? CVPR 2025
Evaluating distillation methods for data-efficient syntax learning EMNLP 2025
Learning from Committee: Reasoning Distillation from a Mixture of Teachers with Peer-Review ACL 2025
Knowledge Distillation for Learned Image Compression ICCV 2025
Towards the Law of Capacity Gap in Distilling Language Models ACL 2025
Towards Efficient CoT Distillation: Self-Guided Rationale Selector for Better Performance with Fewer Rationales EMNLP 2025
Comparative Knowledge Distillation WACV 2025
RTSM: Knowledge Distillation with Diverse Signals for Efficient Real-Time Semantic Matching in E-Commerce NAACL 2025
BiLD: Bi-directional Logits Difference Loss for Large Language Model Distillation COLING 2025
Knowledge Distillation with Refined Logits ICCV 2025
Comprehensive and Efficient Distillation for Lightweight Sentiment Analysis Models EMNLP 2025
What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025