conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Exploring the Benefits and Limitations of Multilinguality for Non-autoregressive Machine Translation EMNLP 2022
Learning an Artificial Language for Knowledge-Sharing in Multilingual Translation EMNLP 2022
Elastic-Link for Binarized Neural Networks AAAI 2022
Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation NIPS 2022
DNA: Proximal Policy Optimization with a Dual Network Architecture NIPS 2022
Improved Feature Distillation via Projector Ensemble NIPS 2022
Toward Understanding Privileged Features Distillation in Learning-to-Rank NIPS 2022
MobileFaceSwap: A Lightweight Framework for Video Face Swapping AAAI 2022
Functional Ensemble Distillation NIPS 2022
Efficient and Modular Implicit Differentiation NIPS 2022
What Makes a "Good" Data Augmentation in Knowledge Distillation - A Statistical Perspective NIPS 2022
Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillation NIPS 2022
Symbolic Distillation for Learned TCP Congestion Control NIPS 2022
XTC: Extreme Compression for Pre-trained Transformers Made Simple and Efficient NIPS 2022
SeqPATE: Differentially Private Text Generation via Knowledge Distillation NIPS 2022
Look Around and Refer: 2D Synthetic Semantics Knowledge Distillation for 3D Visual Grounding NIPS 2022
Meta-Learning with Self-Improving Momentum Target NIPS 2022
Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation NIPS 2022
Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively NIPS 2022
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers NIPS 2022
Class-Wise Adaptive Self Distillation for Federated Learning on Non-IID Data (Student Abstract) AAAI 2022
Federated Learning from Pre-Trained Models: A Contrastive Learning Approach NIPS 2022
Deep Model Reassembly NIPS 2022
On Efficient Online Imitation Learning via Classification NIPS 2022
Offline Multi-Agent Reinforcement Learning with Knowledge Distillation NIPS 2022