← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimation AAAI 2021
PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity Recognition EMNLP 2021
Mutual-Learning Improves End-to-End Speech Translation EMNLP 2021
Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation Networks EMNLP 2021
Learning Compact Metrics for MT EMNLP 2021
Slimmable Generative Adversarial Networks AAAI 2021
Continual Learning for Named Entity Recognition AAAI 2021
GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learning AAAI 2021
Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching AAAI 2021
Thinking Fast and Slow: Efficient Text-to-Visual Retrieval With Transformers CVPR 2021
Multi-Domain Multi-Task Rehearsal for Lifelong Learning AAAI 2021
Incremental Embedding Learning via Zero-Shot Translation AAAI 2021
Peer Collaborative Learning for Online Knowledge Distillation AAAI 2021
Enhanced Audio Tagging via Multi- to Single-Modal Teacher-Student Mutual Learning AAAI 2021
A Student-Teacher Architecture for Dialog Domain Adaptation Under the Meta-Learning Setting AAAI 2021
TAILOR: Teaching with Active and Incremental Learning for Object Registration AAAI 2021
Unleash GPT-2 Power for Event Detection ACL 2021
Split-and-Bridge: Adaptable Class Incremental Learning within a Single Neural Network AAAI 2021
A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection AAAI 2021
Knowledge Refinery: Learning from Decoupled Label AAAI 2021
AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling CVPR 2021
There Is More Than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking With Sound by Distilling Multimodal Knowledge CVPR 2021
Anycost GANs for Interactive Image Synthesis and Editing CVPR 2021
Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation Extraction ACL 2021
Towards Quantifiable Dialogue Coherence Evaluation ACL 2021