Knowledge Distillation

Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillation ICLR 2024 Toward Student-oriented Teacher Network Training for Knowledge Distillation ICLR 2024 ToXCL: A Unified Framework for Toxic Speech Detection and Explanation NAACL 2024 Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition ACL 2024 Training a Better Chinese Spelling Correction Model via Prior-knowledge Guided Teacher ACL 2024 TransAgent: Transfer Vision-Language Foundation Models with Heterogeneous Agent Collaboration NeurIPS 2024 TransferCVLM: Transferring Cross-Modal Knowledge for Vision-Language Modeling EMNLP 2024 Transformer as Linear Expansion of Learngene AAAI 2024 Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models NeurIPS 2024 Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learner NeurIPS 2024 Translate Meanings, Not Just Words: IdiomKB’s Role in Optimizing Idiomatic Translation with Language Models AAAI 2024 TriSum: Learning Summarization Ability from Large Language Models with Structured Rationale NAACL 2024 Trust in Internal or External Knowledge? Generative Multi-Modal Entity Linking with Knowledge Retriever ACL 2024 TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models EMNLP 2024 Turning Dust into Gold: Distilling Complex Reasoning Capabilities from LLMs by Leveraging Negative Data AAAI 2024 Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging NeurIPS 2024 UDON: Universal Dynamic Online distillatioN for generic image representations NeurIPS 2024 UEGP: Unified Expert-Guided Pre-training for Knowledge Rekindle NAACL 2024 Uncertainty-Guided Never-Ending Learning to Drive CVPR 2024 Understanding the Gains from Repeated Self-Distillation NeurIPS 2024 Understanding the Role of the Projector in Knowledge Distillation AAAI 2024 UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling ICLR 2024 UniADS: Universal Architecture-Distiller Search for Distillation Gap AAAI 2024 Unified Insights: Harnessing Multi-modal Data for Phenotype Imputation via View Decoupling NeurIPS 2024 UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory CVPR 2024