← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Intuitive Access to Smartphone Settings Using Relevance Model Trained by Contrastive Learning AAAI 2023
Goal-Conditioned Q-learning as Knowledge Distillation AAAI 2023
Efficient Training of Large-Scale Industrial Fault Diagnostic Models through Federated Opportunistic Block Dropout AAAI 2023
Semi-attention Partition for Occluded Person Re-identification AAAI 2023
Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023
Learning to Imagine: Distillation-Based Interactive Context Exploitation for Dialogue State Tracking AAAI 2023
Mixture Uniform Distribution Modeling and Asymmetric Mix Distillation for Class Incremental Learning AAAI 2023
GLUECons: A Generic Benchmark for Learning under Constraints AAAI 2023
Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation ACL 2023
Symbolic Chain-of-Thought Distillation: Small Models Can Also “Think” Step-by-Step ACL 2023
Gradient-based Intra-attention Pruning on Pre-trained Language Models ACL 2023
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization ACL 2023
Distilling Script Knowledge from Large Language Models for Constrained Language Planning ACL 2023
Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023
Continual Knowledge Distillation for Neural Machine Translation ACL 2023
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation ACL 2023
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression ACL 2023
Towards Better Entity Linking with Multi-View Enhanced Distillation ACL 2023
Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models ACL 2023
Large Language Models Are Reasoning Teachers ACL 2023
ReAugKD: Retrieval-Augmented Knowledge Distillation For Pre-trained Language Models ACL 2023
Teaching Small Language Models to Reason ACL 2023
HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Tasks ACL 2023
Storyline-Centric Detection of Aphasia and Dysarthria in Stroke Patient Transcripts ACL 2023
Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling ACL 2023