conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification CVPR 2021
Compatibility-Aware Heterogeneous Visual Search CVPR 2021
Positive-Congruent Training: Towards Regression-Free Model Updates CVPR 2021
Knowledge Evolution in Neural Networks CVPR 2021
Meta Pseudo Labels CVPR 2021
BERTAC: Enhancing Transformer-based Language Models with Adversarially Pretrained Convolutional Neural Networks ACL 2021
Hate Speech Detection Based on Sentiment Knowledge Sharing ACL 2021
An Overview of Uncertainty Calibration for Text Classification and the Role of Distillation IJCNLP 2021
Teacher Guided Neural Architecture Search for Face Recognition AAAI 2021
On Knowledge Distillation for Translating Erroneous Speech Transcriptions ACL 2021
Multi-Domain Multi-Task Rehearsal for Lifelong Learning AAAI 2021
GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learning AAAI 2021
Slimmable Generative Adversarial Networks AAAI 2021
SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimation AAAI 2021
Robust Knowledge Transfer via Hybrid Forward on the Teacher-Student Model AAAI 2021
HAD-Net: A Hierarchical Adversarial Knowledge Distillation Network for Improved Enhanced Tumour Segmentation Without Post-Contrast Images MIDL 2021
Adversarial Teacher-Student Representation Learning for Domain Generalization NIPS 2021
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task ACL 2021
CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks EMNLP 2021
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates ACL 2021
Do Not Forget to Attend to Uncertainty While Mitigating Catastrophic Forgetting WACV 2021
Selective Knowledge Distillation for Neural Machine Translation ACL 2021
Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation ACL 2021
Noise as a Resource for Learning in Knowledge Distillation WACV 2021
Asynchronous Teacher Guided Bit-wise Hard Mining for Online Hashing AAAI 2021