Knowledge Distillation

Learn More for Food Recognition via Progressive Self-Distillation AAAI 2023 Length-Adaptive Distillation: Customizing Small Language Model for Dynamic Token Pruning EMNLP 2023 Less is More: Task-aware Layer-wise Distillation for Language Model Compression ICML 2023 Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation EMNLP 2023 Leveraging Contrastive Learning and Knowledge Distillation for Incomplete Modality Rumor Detection EMNLP 2023 Leveraging Semantic Information for Efficient Self-Supervised Emotion Recognition with Audio-Textual Distilled Models Interspeech 2023 Leveraging Vision-Centric Multi-Modal Expertise for 3D Object Detection NeurIPS 2023 Lifelong Compression Mixture Model via Knowledge Relationship Graph AAAI 2023 Lifelong Variational Autoencoder via Online Adversarial Expansion Strategy AAAI 2023 Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023 LIMIP: Lifelong Learning to Solve Mixed Integer Programs AAAI 2023 Linkless Link Prediction via Relational Distillation ICML 2023 Lion: Adversarial Distillation of Proprietary Large Language Models EMNLP 2023 LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models EMNLP 2023 LLM aided semi-supervision for efficient Extractive Dialog Summarization EMNLP 2023 Localized Symbolic Knowledge Distillation for Visual Commonsense Models NeurIPS 2023 Logit-based ensemble distribution distillation for robust autoregressive sequence uncertainties UAI 2023 Long-Tailed Question Answering in an Open World ACL 2023 Low-Confidence Samples Mining for Semi-supervised Object Detection IJCAI 2023 Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA EMNLP 2023 MAPL: Parameter-Efficient Adaptation of Unimodal Pre-Trained Models for Vision-Language Few-Shot Prompting EACL 2023 Margin-based Neural Network Watermarking ICML 2023 MaskBooster: End-to-End Self-Training for Sparsely Supervised Instance Segmentation AAAI 2023 Masked Autoencoders Are Stronger Knowledge Distillers ICCV 2023 Masked Autoencoders Enable Efficient Knowledge Distillers CVPR 2023