conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learning CVPR 2022
Contextual Similarity Distillation for Asymmetric Image Retrieval CVPR 2022
Decoupled Knowledge Distillation CVPR 2022
Class Similarity Weighted Knowledge Distillation for Continual Semantic Segmentation CVPR 2022
Pre-Train, Self-Train, Distill: A Simple Recipe for Supersizing 3D Reconstruction CVPR 2022
Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning CVPR 2022
Structured Sparse R-CNN for Direct Scene Graph Generation CVPR 2022
MiniViT: Compressing Vision Transformers With Weight Multiplexing CVPR 2022
Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability CVPR 2022
Co-Advise: Cross Inductive Bias Distillation CVPR 2022
Knowledge Distillation via the Target-Aware Transformer CVPR 2022
DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers CVPR 2022
Target-Relevant Knowledge Preservation for Multi-Source Domain Adaptive Object Detection CVPR 2022
CDGP: Automatic Cloze Distractor Generation based on Pre-trained Language Model EMNLP 2022
AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models EMNLP 2022
Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context Experts EMNLP 2022
Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT EMNLP 2022
JANUS: Joint Autoregressive and Non-autoregressive Training with Auxiliary Loss for Sequence Generation EMNLP 2022
The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains EMNLP 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing EMNLP 2022
Bridging Fairness and Environmental Sustainability in Natural Language Processing EMNLP 2022
HW-TSC’s Submission for the WMT22 Efficiency Task EMNLP 2022
CUNI Non-Autoregressive System for the WMT 22 Efficient Translation Shared Task EMNLP 2022
HW-TSC’s Submissions to the WMT 2022 General Machine Translation Shared Task EMNLP 2022
The AISP-SJTU Translation System for WMT 2022 EMNLP 2022