conftrace_

masked language modeling

316 papers

Explore in graph

Also known as

MLM

Co-occurring keywords

transfer learning (5449) self-supervised learning (3777) masked language model (334) representation learning (6206) pre-trained language model (1515) text classification (6793) domain adaptation (4595) low-resource language (2273) cross-lingual transfer (1477) contrastive learning (4032)

Papers

Identifying Elements Essential for BERT’s Multilinguality EMNLP 2020
TNT: Text Normalization based Pre-training of Transformers for Content Moderation EMNLP 2020
Controlling the Imprint of Passivization and Negation in Contextualized Representations EMNLP 2020
Enabling Language Models to Fill in the Blanks ACL 2020
On the Cross-lingual Transferability of Monolingual Representations ACL 2020
Masked Reasoner at SemEval-2020 Task 4: Fine-Tuning RoBERTa for Commonsense Reasoning COLING 2020
Retrieval Augmented Language Model Pre-Training ICML 2020
Commonsense Knowledge Mining from Pretrained Models IJCNLP 2019
AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models IJCNLP 2019
Mask-Predict: Parallel Decoding of Conditional Masked Language Models IJCNLP 2019
LXMERT: Learning Cross-Modality Encoder Representations from Transformers IJCNLP 2019
BERT Masked Language Modeling for Co-reference Resolution ACL 2019
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives IJCNLP 2019
Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling IJCNLP 2019
Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling EMNLP 2019
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives EMNLP 2019