student model

From Coarse to Fine: Enable Comprehensive Graph Self-supervised Learning with Multi-granular Semantic Ensemble ICML 2024 ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfer ACL 2024 KARL: Knowledge-Aware Retrieval and Representations aid Retention and Learning in Students EMNLP 2024 Knowledge Distillation Based on Transformed Teacher Matching ICLR 2024 Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget NAACL 2024 Knowledge Distillation with Auxiliary Variable ICML 2024 Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL EMNLP 2024 Leveraging Vision-Language Models for Improving Domain Generalization in Image Classification CVPR 2024 Logit Standardization in Knowledge Distillation CVPR 2024 Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation ECCV 2024 MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts COLING 2024 Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation NeurIPS 2024 PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs ACL 2024 Revisiting Knowledge Distillation for Autoregressive Language Models ACL 2024 Semi-supervised Segmentation of Histopathology Images with Noise-Aware Topological Consistency ECCV 2024 Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios ACL 2024 Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition ACL 2024 Understanding the Role of the Projector in Knowledge Distillation AAAI 2024 Using Early Readouts To Mediate Featural Bias in Distillation WACV 2024 When Babies Teach Babies: Can student knowledge sharing outperform Teacher-Guided Distillation on small datasets? CoNLL 2024 Adaptive Contrastive Knowledge Distillation for BERT Compression ACL 2023 Adversarial Local Distribution Regularization for Knowledge Distillation WACV 2023 Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial Distillation CVPR 2023 Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-Width Deep Neural Networks WACV 2023 Cost-effective Distillation of Large Language Models ACL 2023