← Keywords

masked language model

332 papers

Explore in graph

Also known as

PMLM MLM BERT PLM

Co-occurring keywords

transfer learning (5442) text classification (6776) masked language modeling (315) pre-trained language model (1514) representation learning (6174) named entity recognition (2801) language model (4573) domain adaptation (4578) text generation (2903) cross-lingual transfer (1468)

Papers

Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training AAAI 2021
Boosting Low-Resource Biomedical QA via Entity-Aware Masking Strategies EACL 2021
MVP-BERT: Multi-Vocab Pre-training for Chinese BERT ACL 2021
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation ACL 2021
JuriBERT: A Masked-Language Model Adaptation for French Legal Text EMNLP 2021
Frustratingly Easy Edit-based Linguistic Steganography with a Masked Language Model NAACL 2021
UDALM: Unsupervised Domain Adaptation through Language Modeling NAACL 2021
Static Embeddings as Efficient Knowledge Bases? NAACL 2021
PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction ACL 2021
Towards Semantics-Enhanced Pre-Training: Can Lexicon Definitions Help Learning Sentence Meanings? AAAI 2021
Unsupervised Pronoun Resolution via Masked Noun-Phrase Prediction ACL 2021
When does Further Pre-training MLM Help? An Empirical Study on Task-Oriented Dialog Pre-training EMNLP 2021
Learning Prototypical Functions for Physical Artifacts IJCNLP 2021
Lightweight Cross-Lingual Sentence Representation Learning IJCNLP 2021
Cambridge at SemEval-2021 Task 2: Neural WiC-Model with Data Augmentation and Exploration of Representation ACL 2021
Positional Artefacts Propagate Through Masked Language Model Embeddings ACL 2021
Effective Use of Graph Convolution Network and Contextual Sub-Tree for Commodity News Event Extraction EMNLP 2021
Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model IJCNLP 2021
Mask-Align: Self-Supervised Neural Word Alignment ACL 2021
NB-MLM: Efficient Domain Adaptation of Masked Language Models for Sentiment Analysis EMNLP 2021
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases IJCNLP 2021
Japanese Zero Anaphora Resolution Can Benefit from Parallel Texts Through Neural Transfer Learning EMNLP 2021
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases ACL 2021
BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation EMNLP 2021
UNBNLP at SemEval-2021 Task 1: Predicting lexical complexity with masked language models and character-level encoders ACL 2021