← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

An Effective, Performant Named Entity Recognition System for Noisy Business Telephone Conversation Transcripts COLING 2022
Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-Guided Feature Imitation AAAI 2022
Efficient and Modular Implicit Differentiation NIPS 2022
Self-Distillation with Meta Learning for Knowledge Graph Completion EMNLP 2022
Knowledge Stimulated Contrastive Prompting for Low-Resource Stance Detection EMNLP 2022
Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue EMNLP 2022
Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation EMNLP 2022
Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders EMNLP 2022
ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks EMNLP 2022
Discovering and Overcoming Limitations of Noise-engineered Data-free Knowledge Distillation NIPS 2022
Weighted Distillation with Unlabeled Examples NIPS 2022
Few-Shot Class-Incremental Learning for Named Entity Recognition ACL 2022
Confidence Based Bidirectional Global Context Aware Training Framework for Neural Machine Translation ACL 2022
A Flexible Multi-Task Model for BERT Serving ACL 2022
What Makes a "Good" Data Augmentation in Knowledge Distillation - A Statistical Perspective NIPS 2022
Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillation NIPS 2022
Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation NIPS 2022
Weighted Mutual Learning with Diversity-Driven Model Compression NIPS 2022
Are All Linear Regions Created Equal? AISTATS 2022
XTC: Extreme Compression for Pre-trained Transformers Made Simple and Efficient NIPS 2022
When the Student Becomes the Master: Learning Better and Smaller Monolingual Models from mBERT COLING 2022
SeqPATE: Differentially Private Text Generation via Knowledge Distillation NIPS 2022
Look Around and Refer: 2D Synthetic Semantics Knowledge Distillation for 3D Visual Grounding NIPS 2022
Measuring and Reducing Model Update Regression in Structured Prediction for NLP NIPS 2022
Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural Networks NIPS 2022