knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Teacher Guided Neural Architecture Search for Face Recognition AAAI 2021

ESPnet-ST IWSLT 2021 Offline Speech Translation System ACL 2021

Instance-Conditional Knowledge Distillation for Object Detection NIPS 2021

Cross-Category Video Highlight Detection via Set-Based Learning ICCV 2021

In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval ACL 2021

BERTAC: Enhancing Transformer-based Language Models with Adversarially Pretrained Convolutional Neural Networks ACL 2021

OpenMix: Reviving Known Knowledge for Discovering Novel Visual Categories in an Open World CVPR 2021

FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task ACL 2021

Towards Faster Deep Collaborative Filtering via Hierarchical Decision Networks AAAI 2021

HAD-Net: A Hierarchical Adversarial Knowledge Distillation Network for Improved Enhanced Tumour Segmentation Without Post-Contrast Images MIDL 2021

Samsung R&D Institute Poland submission to WAT 2021 Indic Language Multilingual Task ACL 2021

CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks EMNLP 2021

Trigger is Not Sufficient: Exploiting Frame-aware Knowledge for Implicit Event Argument Extraction ACL 2021

Introspective Distillation for Robust Question Answering NIPS 2021

Claim Matching Beyond English to Scale Global Fact-Checking ACL 2021

Distilling Object Detectors with Feature Richness NIPS 2021

Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation ACL 2021

Automatic ICD Coding via Interactive Shared Representation Networks with Self-distillation Mechanism ACL 2021

Hate Speech Detection Based on Sentiment Knowledge Sharing ACL 2021

Deeplite NeutrinoTM: A BlackBox Framework for Constrained Deep Learning Model Optimization AAAI 2021

Revisiting Pretraining with Adapters ACL 2021

Adversarial Teacher-Student Representation Learning for Domain Generalization NIPS 2021

Towards Quantifiable Dialogue Coherence Evaluation IJCNLP 2021

Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates ACL 2021

BinaryBERT: Pushing the Limit of BERT Quantization ACL 2021