Skip to content
conftrace_

weight distillation

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

knowledge distillation (2) biomedical language model (1) masking strategy (1) neural network parameter (1) neural network (1) biomedical nlp (1) parameter transfer (1) language model (1) named entity recognition (1) curriculum learning (1)

Papers

BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity Recognition ACL 2023 Weight Distillation: Transferring the Knowledge in Neural Network Parameters ACL 2021