conftrace_

random-span masking

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

token n-gram (1) whole word masking (1) language model pretraining (1) pointwise mutual information (1) masked language model (1)

Papers

PMI-Masking: Principled masking of correlated spans ICLR 2021