conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Assist Non-native Viewers: Multimodal Cross-Lingual Summarization for How2 Videos EMNLP 2022
Cross-Task Knowledge Distillation in Multi-Task Recommendation AAAI 2022
TrustAL: Trustworthy Active Learning Using Knowledge Distillation AAAI 2022
Improving Neural Cross-Lingual Abstractive Summarization via Employing Optimal Transport Distance for Knowledge Distillation AAAI 2022
Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic Data WACV 2022
PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression WACV 2022
Boosting Deep CTR Prediction with a Plug-and-Play Pre-trainer for News Recommendation COLING 2022
Supervised Compression for Resource-Constrained Edge Computing Systems WACV 2022
Reweighting Strategy Based on Synthetic Data Identification for Sentence Similarity COLING 2022
Safe Distillation Box AAAI 2022
Self-Guidance: Improve Deep Neural Network Generalization via Knowledge Distillation WACV 2022
Boosting Contrastive Learning with Relation Knowledge Distillation AAAI 2022
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher COLING 2022
SDQ: Stochastic Differentiable Quantization with Mixed Precision ICML 2022
MGAD: Learning Descriptional Representation Distilled from Distributional Semantics for Unseen Entities IJCAI 2022
Low-Cost Multispectral Scene Analysis With Modality Distillation WACV 2022
Boosting Multi-Label Image Classification with Complementary Parallel Self-Distillation IJCAI 2022
Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers AAAI 2022
CMU’s IWSLT 2022 Dialect Speech Translation System ACL 2022
Using time-series privileged information for provably efficient learning of prediction models AISTATS 2022
Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing? ICML 2022
From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression AAAI 2022
The Xiaomi Text-to-Text Simultaneous Speech Translation System for IWSLT 2022 ACL 2022
Pseudo-spherical Knowledge Distillation IJCAI 2022
In defense of dual-encoders for neural ranking ICML 2022