knowledge distillation

Teacher Guided Training: An Efficient Framework for Knowledge Transfer ICLR 2023 Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023 Teaching Small Language Models to Reason ACL 2023 Teaching What You Should Teach: A Data-Based Distillation Method IJCAI 2023 Teamwork Is Not Always Good: An Empirical Study of Classifier Drift in Class-incremental Information Extraction ACL 2023 TempLM: Distilling Language Models into Template-Based Generators ACL 2023 TeSLA: Test-Time Self-Learning With Automatic Adversarial Augmentation CVPR 2023 TexQ: Zero-shot Network Quantization with Texture Feature Distribution Calibration NeurIPS 2023 Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation EACL 2023 Text Representation Distillation via Information Bottleneck Principle EMNLP 2023 The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image ICLR 2023 The Best of Both Worlds: Accurate Global and Personalized Models through Federated Learning with Data-Free Hyper-Knowledge Distillation ICLR 2023 The economic trade-offs of large language models: A case study ACL 2023 The MineTrans Systems for IWSLT 2023 Offline Speech Translation and Speech-to-Speech Translation Tasks ACL 2023 The student becomes the master: Outperforming GPT3 on Scientific Factual Error Correction EMNLP 2023 The Unreasonable Effectiveness of Large Language-Vision Models for Source-Free Video Domain Adaptation ICCV 2023 TimeBalance: Temporally-Invariant and Temporally-Distinctive Video Representations for Semi-Supervised Action Recognition CVPR 2023 TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance ICCV 2023 TinyHD: Efficient Video Saliency Prediction With Heterogeneous Decoders Using Hierarchical Maps Distillation WACV 2023 TinyMIM: An Empirical Study of Distilling MIM Pre-Trained Models CVPR 2023 Tiny Updater: Towards Efficient Neural Network-Driven Software Updating ICCV 2023 Token-Scaled Logit Distillation for Ternary Weight Generative Language Models NeurIPS 2023 torchdistill Meets Hugging Face Libraries for Reproducible, Coding-Free Deep Learning Studies: A Case Study on NLP EMNLP 2023 Toward Fairness in Text Generation via Mutual Information Minimization based on Importance Sampling AISTATS 2023 Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval CVPR 2023