Skip to content
conftrace_

masked language modeling

303 papers

Explore in graph

Also known as

MLM

Co-occurring keywords · papers mentioning both

transfer learning (33) self-supervised learning (31) representation learning (28) pre-trained language model (27) masked language model (24) domain adaptation (20) text classification (19) multimodal learning (17) contrastive learning (17) low-resource language (16)

Papers

Enabling Language Models to Fill in the Blanks ACL 2020 HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training EMNLP 2020 Identifying Elements Essential for BERT’s Multilinguality EMNLP 2020 Lexical Simplification with Pretrained Encoders AAAI 2020 Masking Orchestration: Multi-Task Pretraining for Multi-Role Dialogue Representation Learning AAAI 2020 MPNet: Masked and Permuted Pre-training for Language Understanding NeurIPS 2020 Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation EMNLP 2020 On Losses for Modern Language Models EMNLP 2020 On the Cross-lingual Transferability of Monolingual Representations ACL 2020 POSTECH-ETRI’s Submission to the WMT2020 APE Shared Task: Automatic Post-Editing with Cross-lingual Language Model EMNLP 2020 Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning ACL 2020 Retrieval Augmented Language Model Pre-Training ICML 2020 Revisiting Pre-Trained Models for Chinese Natural Language Processing EMNLP 2020 SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis ACL 2020 Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity COLING 2020 TNT: Text Normalization based Pre-training of Transformers for Content Moderation EMNLP 2020 TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue EMNLP 2020 Train No Evil: Selective Masking for Task-Guided Pre-Training EMNLP 2020 UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer Networks for Offensive Language Detection SemEval 2020 Unicoder-VL: A Universal Encoder for Vision and Language by Cross-Modal Pre-Training AAAI 2020 Unsupervised Aspect-Level Sentiment Controllable Style Transfer AACL 2020 Unsupervised Cross-lingual Representation Learning at Scale ACL 2020 Visually Grounded Continual Learning of Compositional Phrases EMNLP 2020 Which *BERT? A Survey Organizing Contextualized Encoders EMNLP 2020 BERT Masked Language Modeling for Co-reference Resolution ACL 2019