conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Learning Compact Metrics for MT EMNLP 2021
Flexible Non-Autoregressive Extractive Summarization with Threshold: How to Extract a Non-Fixed Number of Summary Sentences AAAI 2021
VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer NIPS 2021
Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation AAAI 2021
Learning to Reweight with Deep Interactions AAAI 2021
Diverse Knowledge Distillation for End-to-End Person Search AAAI 2021
NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM NIPS 2021
Voice Activity Detection with Teacher-Student Domain Emulation INTERSPEECH 2021
Dealing with training and test segmentation mismatch: FBK@IWSLT2021 ACL 2021
Obtaining Better Static Word Embeddings Using Contextual Embedding Models ACL 2021
A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection AAAI 2021
G-PATE: Scalable Differentially Private Data Generator via Private Aggregation of Teacher Discriminators NIPS 2021
Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework NIPS 2021
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation ACL 2021
Weight Distillation: Transferring the Knowledge in Neural Network Parameters ACL 2021
Continual Learning for Named Entity Recognition AAAI 2021
Data-Free Knowledge Distillation with Soft Targeted Transfer Set Synthesis AAAI 2021
Learning to Augment for Data-scarce Domain BERT Knowledge Distillation AAAI 2021
Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching AAAI 2021
Peer Collaborative Learning for Online Knowledge Distillation AAAI 2021
An Overview of Uncertainty Calibration for Text Classification and the Role of Distillation ACL 2021
NAIST English-to-Japanese Simultaneous Translation System for IWSLT 2021 Simultaneous Text-to-text Task ACL 2021
Distilling Meta Knowledge on Heterogeneous Graph for Illicit Drug Trafficker Detection on Social Media NIPS 2021
FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropout NIPS 2021
Towards Enabling Meta-Learning from Target Models NIPS 2021