conftrace_

masked language modeling

316 papers

Explore in graph

Also known as

MLM

Co-occurring keywords

transfer learning (5449) self-supervised learning (3777) masked language model (334) representation learning (6206) pre-trained language model (1515) text classification (6793) domain adaptation (4595) low-resource language (2273) cross-lingual transfer (1477) contrastive learning (4032)

Papers

From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding NAACL 2021
Unsupervised Pronoun Resolution via Masked Noun-Phrase Prediction ACL 2021
SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding NAACL 2021
Target-Aware Data Augmentation for Stance Detection NAACL 2021
Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Translation NAACL 2021
Reservoir Transformers ACL 2021
ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction ACL 2021
BERT Goes Shopping: Comparing Distributional Models for Product Representations IJCNLP 2021
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling IJCNLP 2021
Larger-Scale Transformers for Multilingual Masked Language Modeling IJCNLP 2021
Unsupervised Pronoun Resolution via Masked Noun-Phrase Prediction IJCNLP 2021
On the Generation of Medical Dialogs for COVID-19 IJCNLP 2021
NUIG-DSI’s submission to The GEM Benchmark 2021 IJCNLP 2021
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling ACL 2021
BERT Goes Shopping: Comparing Distributional Models for Product Representations ACL 2021
Larger-Scale Transformers for Multilingual Masked Language Modeling ACL 2021
TAPAS at SemEval-2021 Task 9: Reasoning over tables with intermediate pre-training SEMEVAL 2021
Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media EMNLP 2021
CDLM: Cross-Document Language Modeling EMNLP 2021
Universal Sentence Representation Learning with Conditional Masked Language Model EMNLP 2021
eMLM: A New Pre-training Objective for Emotion Related Tasks IJCNLP 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment IJCNLP 2021
AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding EACL 2021
Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models EACL 2021
ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction SEMEVAL 2021