conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Unified Data-Free Compression: Pruning and Quantization without Fine-Tuning ICCV 2023
Knowledge Distillation Approach for Efficient Internal Language Model Estimation INTERSPEECH 2023
Distilling Internet-Scale Vision-Language Models into Embodied Agents ICML 2023
Vertical Federated Graph Neural Network for Recommender System ICML 2023
Data Efficient Neural Scaling Law via Model Reusing ICML 2023
Understand and Modularize Generator Optimization in ELECTRA-style Pretraining ICML 2023
SpotEM: Efficient Video Search for Episodic Memory ICML 2023
Semantic Segmentation with Bidirectional Language Models Improves Long-form ASR INTERSPEECH 2023
Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation INTERSPEECH 2023
Understanding Self-Distillation in the Presence of Label Noise ICML 2023
Parallel Neurosymbolic Integration with Concordia ICML 2023
Towards Understanding Ensemble Distillation in Federated Learning ICML 2023
Discrete Continuous Optimization Framework for Simultaneous Clustering and Training in Mixture Models ICML 2023
Linkless Link Prediction via Relational Distillation ICML 2023
Less is More: Task-aware Layer-wise Distillation for Language Model Compression ICML 2023
Understanding the Distillation Process from Deep Generative Models to Tractable Probabilistic Circuits ICML 2023
UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers ICML 2023
Quantifying the Knowledge in GNNs for Reliable Distillation into MLPs ICML 2023
Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning ICML 2023
Margin-based Neural Network Watermarking ICML 2023
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer ACL 2023
MDCS: More Diverse Experts with Consistency Self-distillation for Long-tailed Recognition ICCV 2023
Semi-Supervised Learning via Weight-Aware Distillation under Class Distribution Mismatch ICCV 2023
Knowledge-Aware Federated Active Learning with Non-IID Data ICCV 2023
The MineTrans Systems for IWSLT 2023 Offline Speech Translation and Speech-to-Speech Translation Tasks ACL 2023