← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

Cost-effective Distillation of Large Language Models ACL 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes ACL 2023
Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ACL 2023
A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models ACL 2023
Domain Generalization via Switch Knowledge Distillation for Robust Review Representation ACL 2023
Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillation EMNLP 2023
AdapterDistillation: Non-Destructive Task Composition with Knowledge Distillation EMNLP 2023
Bilateral Memory Consolidation for Continual Learning CVPR 2023
Generative Bias for Robust Visual Question Answering CVPR 2023
MaskBooster: End-to-End Self-Training for Sparsely Supervised Instance Segmentation AAAI 2023
DisGUIDE: Disagreement-Guided Data-Free Model Extraction AAAI 2023
A Neural Span-Based Continual Named Entity Recognition Model AAAI 2023
Better Simultaneous Translation with Monotonic Knowledge Distillation ACL 2023
Injecting knowledge into language generation: a case study in auto-charting after-visit care instructions from medical dialogue ACL 2023
Can LMs Learn New Entities from Descriptions? Challenges in Propagating Injected Knowledge ACL 2023
Matching Pairs: Attributing Fine-Tuned Models to their Pre-Trained Large Language Models ACL 2023
Continual Knowledge Distillation for Neural Machine Translation ACL 2023
Towards Better Entity Linking with Multi-View Enhanced Distillation ACL 2023
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training ACL 2023
Communication Efficient Federated Learning for Multilingual Neural Machine Translation with Adapter ACL 2023
Chain of Thought Prompting Elicits Knowledge Augmentation ACL 2023
Attend, Select and Eliminate: Accelerating Multi-turn Response Selection with Dual-attention-based Content Elimination ACL 2023
ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis ACL 2023
Partial Network Cloning CVPR 2023
Knowledge Distillation ≈ Label Smoothing: Fact or Fallacy? EMNLP 2023