conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Learn More for Food Recognition via Progressive Self-Distillation AAAI 2023
Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation AAAI 2023
Prompting Neural Machine Translation with Translation Memories AAAI 2023
Self-Supervised Continual Graph Learning in Adaptive Riemannian Spaces AAAI 2023
BiT: Robustly Binarized Multi-distilled Transformer NIPS 2022
Q-ViT: Accurate and Fully Quantized Low-bit Vision Transformer NIPS 2022
Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework EMNLP 2022
Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing NIPS 2022
Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning INTERSPEECH 2022
Continual Federated Learning Based on Knowledge Distillation IJCAI 2022
CS-CTCSCONV1D: Small footprint speaker verification with channel split time-channel-time separable 1-dimensional convolution INTERSPEECH 2022
Rainbow Keywords: Efficient Incremental Learning for Online Spoken Keyword Spotting INTERSPEECH 2022
Shadow Knowledge Distillation: Bridging Offline and Online Knowledge Transfer NIPS 2022
KNOT: Knowledge Distillation Using Optimal Transport for Solving NLP Tasks COLING 2022
CILDA: Contrastive Data Augmentation Using Intermediate Layer Knowledge Distillation COLING 2022
Curriculum Knowledge Distillation for Emoji-supervised Cross-lingual Sentiment Analysis EMNLP 2022
Structural Pruning via Latency-Saliency Knapsack NIPS 2022
Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt IJCAI 2022
Learning Multiple Adverse Weather Removal via Two-Stage Knowledge Learning and Multi-Contrastive Regularization: Toward a Unified Model CVPR 2022
Knowledge Distillation With the Reused Teacher Classifier CVPR 2022
TAKE: Topic-shift Aware Knowledge sElection for Dialogue Generation COLING 2022
Attribute Injection for Pretrained Language Models: A New Benchmark and an Efficient Method COLING 2022
Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks COLING 2022
Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing COLING 2022
Speech Emotion: Investigating Model Representations, Multi-Task Learning and Knowledge Distillation INTERSPEECH 2022