conftrace_

masking policy

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

masked language modeling (2) neural mask generator (1) adaptive masking policy (1) transformer policy network (1) intermediate pretraining (1) off-policy actor-critic (1) mask generation (1) self-supervised pretraining (1) masked language model (1) question answering (1)

Papers

On the Influence of Masking Policies in Intermediate Pre-training EMNLP 2021 Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation EMNLP 2020