← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models ACL 2023
I2R’s End-to-End Speech Translation System for IWSLT 2023 Offline Shared Task ACL 2023
Connective Prediction for Implicit Discourse Relation Recognition via Knowledge Distillation ACL 2023
FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue ACL 2023
Understanding Differential Search Index for Text Retrieval ACL 2023
mCLIP: Multilingual CLIP via Cross-lingual Transfer ACL 2023
A Study on the Efficiency and Generalization of Light Hybrid Retrievers ACL 2023
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model ACL 2023
Multimedia Generative Script Learning for Task Planning ACL 2023
Improving Knowledge Graph Completion with Generative Hard Negative Mining ACL 2023
Better Simultaneous Translation with Monotonic Knowledge Distillation ACL 2023
Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts ACL 2023
RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation ACL 2023
Domain Generalization via Switch Knowledge Distillation for Robust Review Representation ACL 2023
Program Translation via Code Distillation EMNLP 2023
Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval EMNLP 2023
Discourse Structures Guided Fine-grained Propaganda Identification EMNLP 2023
Towards Example-Based NMT with Multi-Levenshtein Transformers EMNLP 2023
Hybrid Inverted Index Is a Robust Accelerator for Dense Retrieval EMNLP 2023
Boosting Summarization with Normalizing Flows and Aggressive Training EMNLP 2023
Event Causality Extraction via Implicit Cause-Effect Interactions EMNLP 2023
Cross-Lingual Cross-Target Stance Detection with Dual Knowledge Distillation Framework EMNLP 2023
Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillation EMNLP 2023
AdapterDistillation: Non-Destructive Task Composition with Knowledge Distillation EMNLP 2023
SKD-NER: Continual Named Entity Recognition via Span-based Knowledge Distillation with Reinforcement Learning EMNLP 2023