conftrace_

masked language modeling

316 papers

Explore in graph

Also known as

MLM

Co-occurring keywords

transfer learning (5449) self-supervised learning (3777) masked language model (334) representation learning (6206) pre-trained language model (1515) text classification (6793) domain adaptation (4595) low-resource language (2273) cross-lingual transfer (1477) contrastive learning (4032)

Papers

Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation EMNLP 2020
Which *BERT? A Survey Organizing Contextualized Encoders EMNLP 2020
Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language Models EMNLP 2020
Train No Evil: Selective Masking for Task-Guided Pre-Training EMNLP 2020
POSTECH-ETRI’s Submission to the WMT2020 APE Shared Task: Automatic Post-Editing with Cross-lingual Language Model EMNLP 2020
Unsupervised Aspect-Level Sentiment Controllable Style Transfer AACL 2020
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis ACL 2020
UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer Networks for Offensive Language Detection SEMEVAL 2020
Deep Transformers with Latent Depth NIPS 2020
MPNet: Masked and Permuted Pre-training for Language Understanding NIPS 2020
Lexical Simplification with Pretrained Encoders AAAI 2020
Revisiting Pre-Trained Models for Chinese Natural Language Processing EMNLP 2020
Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning ACL 2020
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-Modal Pre-Training AAAI 2020
TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue EMNLP 2020
UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer Networks for Offensive Language Detection COLING 2020
Emerging Cross-lingual Structure in Pretrained Language Models ACL 2020
CoLAKE: Contextualized Language and Knowledge Embedding COLING 2020
Unsupervised Cross-lingual Representation Learning at Scale ACL 2020
Visually Grounded Continual Learning of Compositional Phrases EMNLP 2020
Masking Orchestration: Multi-Task Pretraining for Multi-Role Dialogue Representation Learning AAAI 2020
Cross-Thought for Sentence Encoder Pre-training EMNLP 2020
On Losses for Modern Language Models EMNLP 2020
Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity COLING 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training EMNLP 2020