conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

On the distribution of penultimate activations of classification networks UAI 2021
Topic Modeling for Maternal Health Using Reddit EACL 2021
Finding Spoiler Bias in Tweets by Zero-shot Learning and Knowledge Distilling from Neural Text Simplification EACL 2021
Arabic Compact Language Modelling for Resource Limited Devices EACL 2021
AdapterFusion: Non-Destructive Task Composition for Transfer Learning EACL 2021
Annealing Knowledge Distillation EACL 2021
Extremely Small BERT Models from Mixed-Vocabulary Training EACL 2021
DISK-CSV: Distilling Interpretable Semantic Knowledge with a Class Semantic Vector EACL 2021
Dialect Identification through Adversarial Learning and Knowledge Distillation on Romanian BERT EACL 2021
Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network IJCNLP 2021
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders IJCNLP 2021
Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation IJCNLP 2021
Selective Knowledge Distillation for Neural Machine Translation IJCNLP 2021
On Knowledge Distillation for Translating Erroneous Speech Transcriptions IJCNLP 2021
Making Pre-trained Language Models Better Few-shot Learners IJCNLP 2021
Unleash GPT-2 Power for Event Detection IJCNLP 2021
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates IJCNLP 2021
Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation IJCNLP 2021
Claim Matching Beyond English to Scale Global Fact-Checking IJCNLP 2021
The USYD-JD Speech Translation System for IWSLT2021 IJCNLP 2021
Samsung R&D Institute Poland submission to WAT 2021 Indic Language Multilingual Task IJCNLP 2021
POS-Constrained Parallel Decoding for Non-autoregressive Generation IJCNLP 2021
PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation IJCNLP 2021
Continual Representation Learning for Biometric Identification WACV 2021
Effectiveness of Arbitrary Transfer Sets for Data-Free Knowledge Distillation WACV 2021