← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

CocaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval ACL 2023
Injecting knowledge into language generation: a case study in auto-charting after-visit care instructions from medical dialogue ACL 2023
HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation ACL 2023
f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023
Decoder Tuning: Efficient Language Understanding as Decoding ACL 2023
CKDST: Comprehensively and Effectively Distill Knowledge from Machine Translation to End-to-End Speech Translation ACL 2023
Adaptive Contrastive Knowledge Distillation for BERT Compression ACL 2023
Long-Tailed Question Answering in an Open World ACL 2023
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training ACL 2023
Distilling Calibrated Knowledge for Stance Detection ACL 2023
Attend, Select and Eliminate: Accelerating Multi-turn Response Selection with Dual-attention-based Content Elimination ACL 2023
Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog ACL 2023
TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models EMNLP 2023
Knowledge Distillation with Reptile Meta-Learning for Pretrained Language Model Compression COLING 2022
Structural Knowledge Distillation for Object Detection NIPS 2022
Hilbert Distillation for Cross-Dimensionality Networks NIPS 2022
Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification NIPS 2022
TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation NIPS 2022
Towards Efficient 3D Object Detection with Knowledge Distillation NIPS 2022
Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching NIPS 2022
Let Images Give You More: Point Cloud Cross-Modal Training for Shape Analysis NIPS 2022
Knowledge Distillation from A Stronger Teacher NIPS 2022
Distilling Representations from GAN Generator via Squeeze and Span NIPS 2022
An Unsupervised Multiple-Task and Multiple-Teacher Model for Cross-lingual Named Entity Recognition ACL 2022
Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm ACL 2022