conftrace_

mask language modeling

5 papers

Explore in graph

Also known as

MLM

Co-occurring keywords · papers mentioning both

pre-trained language model (2) domain adaptation (2) cross-domain text classification (1) self-supervised distillation (1) soft-masked bert (1) chinese spelling (1) chinese spelling error correction (1) spelling error correction (1) replaced token detection (1) biomedical text mining (1)

Papers

A Two-Stage Framework with Self-Supervised Distillation for Cross-Domain Text Classification COLING 2024 Improving Pre-trained Language Model Sensitivity via Mask Specific losses: A case study on Biomedical NER NAACL 2024 Better Pre-Training by Reducing Representation Confusion EACL 2023 DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing ICLR 2023 Spelling Error Correction with Soft-Masked BERT ACL 2020