← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation INTERSPEECH 2023
Enhancing Abstractiveness of Summarization Models through Calibrated Distillation EMNLP 2023
Learn More for Food Recognition via Progressive Self-Distillation AAAI 2023
Soft Target-Enhanced Matching Framework for Deep Entity Matching AAAI 2023
T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillation AAAI 2023
Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation AAAI 2023
PROTEGE: Prompt-based Diverse Question Generation from Web Articles EMNLP 2023
Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting EMNLP 2023
Distilling ChatGPT for Explainable Automated Student Answer Assessment EMNLP 2023
MCC-KD: Multi-CoT Consistent Knowledge Distillation EMNLP 2023
DistillCSE: Distilled Contrastive Learning for Sentence Embeddings EMNLP 2023
Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023
Accelerating Multiple Intent Detection and Slot Filling via Targeted Knowledge Distillation EMNLP 2023
LLM aided semi-supervision for efficient Extractive Dialog Summarization EMNLP 2023
HuatuoGPT, Towards Taming Language Model to Be a Doctor EMNLP 2023
Don’t Add, don’t Miss: Effective Content Preserving Generation from Pre-Selected Text Spans EMNLP 2023
Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models EMNLP 2023
Tuna: Instruction Tuning using Feedback from Large Language Models EMNLP 2023
Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning CVPR 2023
Semantic Scene Completion With Cleaner Self CVPR 2023
ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector CVPR 2023
Knowledge Distillation for 6D Pose Estimation by Aligning Distributions of Local Predictions CVPR 2023
StructVPR: Distill Structural Knowledge With Weighting Samples for Visual Place Recognition CVPR 2023
Few-Shot Class-Incremental Learning via Class-Aware Bilateral Distillation CVPR 2023
NIFF: Alleviating Forgetting in Generalized Few-Shot Object Detection via Neural Instance Feature Forging CVPR 2023