conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Cross-Modal Distillation for Speaker Recognition AAAI 2023
Four Approaches to Low-Resource Multilingual NMT: The Helsinki Submission to the AmericasNLP 2023 Shared Task ACL 2023
Beyond the Limitation of Monocular 3D Detector via Knowledge Distillation ICCV 2023
Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23 ACL 2023
DOT: A Distillation-Oriented Trainer ICCV 2023
DETRDistill: A Universal Knowledge Distillation Framework for DETR-families ICCV 2023
Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks Using an Incompetent Teacher AAAI 2023
ProKD: An Unsupervised Prototypical Knowledge Distillation Network for Zero-Resource Cross-Lingual Named Entity Recognition AAAI 2023
An Ensemble Distillation Framework for Sentence Embeddings with Multilingual Round-Trip Translation AAAI 2023
Spectral Co-Distillation for Personalized Federated Learning NIPS 2023
Improving Adversarial Robustness via Information Bottleneck Distillation NIPS 2023
FSAR: Federated Skeleton-based Action Recognition with Adaptive Topology Structure and Knowledge Distillation ICCV 2023
Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection ICCV 2023
Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection ICCV 2023
T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillation AAAI 2023
Exploring Self-Distillation Based Relational Reasoning Training for Document-Level Relation Extraction AAAI 2023
ProtoTransfer: Cross-Modal Prototype Transfer for Point Cloud Segmentation ICCV 2023
The economic trade-offs of large language models: A case study ACL 2023
Class Lifelong Learning for Intent Detection via Structure Consolidation Networks ACL 2023
TempLM: Distilling Language Models into Template-Based Generators ACL 2023
Learning Answer Generation using Supervision from Automatic Question Answering Evaluators ACL 2023
Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models ACL 2023
Revisiting Commonsense Reasoning in Machine Translation: Training, Evaluation and Challenge ACL 2023
A Simple Concatenation can Effectively Improve Speech Translation ACL 2023
How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives ACL 2023