masked language modeling

Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach EMNLP 2021 From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding NAACL 2021 Frustratingly Simple Pretraining Alternatives to Masked Language Modeling EMNLP 2021 GraphCodeBERT: Pre-training Code Representations with Data Flow ICLR 2021 GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing ICLR 2021 Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment ACL 2021 Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Translation NAACL 2021 Larger-Scale Transformers for Multilingual Masked Language Modeling ACL 2021 Learning Prototypical Functions for Physical Artifacts ACL 2021 Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little EMNLP 2021 MeLT: Message-Level Transformer with Masked Document Representations as Pre-Training for Stance Detection EMNLP 2021 MERMAID: Metaphor Generation with Symbolism and Discriminative Decoding NAACL 2021 MG-BERT: Multi-Graph Augmented BERT for Masked Language Modeling NAACL 2021 Modeling Mathematical Notation Semantics in Academic Papers EMNLP 2021 MSA Transformer ICML 2021 Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models EACL 2021 Noobs at Semeval-2021 Task 4: Masked Language Modeling for abstract answer prediction SemEval 2021 On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies NAACL 2021 On the Influence of Masking Policies in Intermediate Pre-training EMNLP 2021 Probing Pre-trained Language Models for Semantic Attributes and their Values EMNLP 2021 Putting Words in BERT’s Mouth: Navigating Contextualized Vector Spaces with Pseudowords EMNLP 2021 ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction SemEval 2021 Reservoir Transformers ACL 2021 Rethinking Denoised Auto-Encoding in Language Pre-Training EMNLP 2021 SCRIPT: Self-Critic PreTraining of Transformers NAACL 2021