conftrace_

student model

107 papers

Explore in graph

Co-occurring keywords

knowledge distillation (3725) model compression (3302) teacher model (53) large language model (13587) language model (4599) transfer learning (5449) neural network (6616) representation learning (6206) text classification (6793) relational knowledge (26)

Papers

Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning EMNLP 2024
Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL EMNLP 2024
Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition ACL 2024
FreeKD: Knowledge Distillation via Semantic Frequency Prompt CVPR 2024
KARL: Knowledge-Aware Retrieval and Representations aid Retention and Learning in Students EMNLP 2024
Using Early Readouts To Mediate Featural Bias in Distillation WACV 2024
Adversarial Moment-Matching Distillation of Large Language Models NIPS 2024
Cost-effective Distillation of Large Language Models ACL 2023
IMF: Integrating Matched Features Using Attentive Logit in Knowledge Distillation IJCAI 2023
Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-Width Deep Neural Networks WACV 2023
DisCo: Distilled Student Models Co-training for Semi-supervised Text Mining EMNLP 2023
Linkless Link Prediction via Relational Distillation ICML 2023
ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector CVPR 2023
Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial Distillation CVPR 2023
Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation EMNLP 2023
Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval CVPR 2023
Adaptive Contrastive Knowledge Distillation for BERT Compression ACL 2023
KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation EMNLP 2023
Knowledge Distillation Performs Partial Variance Reduction NIPS 2023
DOT: A Distillation-Oriented Trainer ICCV 2023
SKDBERT: Compressing BERT via Stochastic Knowledge Distillation AAAI 2023
DisWOT: Student Architecture Search for Distillation WithOut Training CVPR 2023
Progressive Ensemble Distillation: Building Ensembles for Efficient Inference NIPS 2023
Adversarial Local Distribution Regularization for Knowledge Distillation WACV 2023
Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation NIPS 2022