← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Improving Zero-Shot Multilingual Text Generation via Iterative Distillation COLING 2022
An Efficient Combinatorial Optimization Model Using Learning-to-Rank Distillation AAAI 2022
Up to 100x Faster Data-Free Knowledge Distillation AAAI 2022
RetGen: A Joint Framework for Retrieval and Grounded Text Generation Modeling AAAI 2022
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation AAAI 2022
Preserving Privacy in Federated Learning with Ensemble Cross-Domain Knowledge Distillation AAAI 2022
Efficient Knowledge Distillation from Model Checkpoints NIPS 2022
Association Graph Learning for Multi-Task Classification with Category Shifts NIPS 2022
Uncertainty-Aware Hierarchical Refinement for Incremental Implicitly-Refined Classification NIPS 2022
Handwritten Mathematical Expression Recognition via Attention Aggregation Based Bi-directional Mutual Learning AAAI 2022
NaturalInversion: Data-Free Image Synthesis Improving Real-World Consistency AAAI 2022
TVT: Three-Way Vision Transformer through Multi-Modal Hypersphere Learning for Zero-Shot Sketch-Based Image Retrieval AAAI 2022
Robust and Resource-Efficient Data-Free Knowledge Distillation by Generative Pseudo Replay AAAI 2022
Cosine Model Watermarking against Ensemble Distillation AAAI 2022
Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation NIPS 2022
Toward Understanding Privileged Features Distillation in Learning-to-Rank NIPS 2022
DKPLM: Decomposable Knowledge-Enhanced Pre-trained Language Model for Natural Language Understanding AAAI 2022
From Fully Trained to Fully Random Embeddings: Improving Neural Machine Translation with Compact Word Embedding Tables AAAI 2022
Deliberated Domain Bridging for Domain Adaptive Semantic Segmentation NIPS 2022
Functional Ensemble Distillation NIPS 2022
Elastic-Link for Binarized Neural Networks AAAI 2022
PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient NIPS 2022
Enhancing Task-Specific Distillation in Small Data Regimes through Language Generation COLING 2022
Sentiment Interpretable Logic Tensor Network for Aspect-Term Sentiment Analysis COLING 2022
Making Parameter-efficient Tuning More Efficient: A Unified Framework for Classification Tasks COLING 2022