conftrace_

student model

107 papers

Explore in graph

Co-occurring keywords

knowledge distillation (3725) model compression (3302) teacher model (53) large language model (13587) language model (4599) transfer learning (5449) neural network (6616) representation learning (6206) text classification (6793) relational knowledge (26)

Papers

DL-KDD: Dual-Lightness Knowledge Distillation for Action Recognition in the Dark IJCAI 2025
Active Large Language Model-Based Knowledge Distillation for Session-Based Recommendation AAAI 2025
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation ACL 2025
What Makes a Good Dataset for Knowledge Distillation? CVPR 2025
Random Conditioning for Diffusion Model Compression with Distillation CVPR 2025
Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025
Revisiting Intermediate-Layer Matching in Knowledge Distillation: Layer-Selection Strategy Doesn’t Matter (Much) AACL 2025
Can Students Beyond the Teacher? Distilling Knowledge from Teacher’s Bias AAAI 2025
Logit Standardization in Knowledge Distillation CVPR 2024
Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning EMNLP 2024
Leveraging Vision-Language Models for Improving Domain Generalization in Image Classification CVPR 2024
Cache & Distil: Optimising API Calls to Large Language Models ACL 2024
Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL EMNLP 2024
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation NIPS 2024
Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios ACL 2024
ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfer ACL 2024
CorrSynth - A Correlated Sampling Method for Diverse Dataset Generation from LLMs EMNLP 2024
Understanding the Role of the Projector in Knowledge Distillation AAAI 2024
Revisiting Knowledge Distillation for Autoregressive Language Models ACL 2024
MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts COLING 2024
KARL: Knowledge-Aware Retrieval and Representations aid Retention and Learning in Students EMNLP 2024
Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition ACL 2024
FreeKD: Knowledge Distillation via Semantic Frequency Prompt CVPR 2024
PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs ACL 2024
Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget NAACL 2024