conftrace_

masked language modeling

316 papers

Explore in graph

Also known as

MLM

Co-occurring keywords

transfer learning (5449) self-supervised learning (3777) masked language model (334) representation learning (6206) pre-trained language model (1515) text classification (6793) domain adaptation (4595) low-resource language (2273) cross-lingual transfer (1477) contrastive learning (4032)

Papers

TAPAS at SemEval-2021 Task 9: Reasoning over tables with intermediate pre-training ACL 2021
A Thorough Evaluation of Task-Specific Pretraining for Summarization EMNLP 2021
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little EMNLP 2021
Rethinking Denoised Auto-Encoding in Language Pre-Training EMNLP 2021
Noobs at Semeval-2021 Task 4: Masked Language Modeling for abstract answer prediction IJCNLP 2021
ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning EMNLP 2021
XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract Meaning ACL 2021
Segatron: Segment-Aware Transformer for Language Modeling and Understanding AAAI 2021
MSA Transformer ICML 2021
MG-BERT: Multi-Graph Augmented BERT for Masked Language Modeling NAACL 2021
TAP: Text-Aware Pre-Training for Text-VQA and Text-Caption CVPR 2021
UC2: Universal Cross-Lingual Cross-Modal Vision-and-Language Pre-Training CVPR 2021
Sentence Bottleneck Autoencoders from Transformer Language Models EMNLP 2021
Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach EMNLP 2021
When does Further Pre-training MLM Help? An Empirical Study on Task-Oriented Dialog Pre-training EMNLP 2021
The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding EMNLP 2021
ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction IJCNLP 2021
Noobs at Semeval-2021 Task 4: Masked Language Modeling for abstract answer prediction SEMEVAL 2021
SupCL-Seq: Supervised Contrastive Learning for Downstream Optimized Sequence Representations EMNLP 2021
Putting Words in BERT’s Mouth: Navigating Contextualized Vector Spaces with Pseudowords EMNLP 2021
Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers EMNLP 2021
BabyBERTa: Learning More Grammar With Small-Scale Child-Directed Language EMNLP 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment ACL 2021
Modeling Mathematical Notation Semantics in Academic Papers EMNLP 2021
Data Efficient Masked Language Modeling for Vision and Language EMNLP 2021