conftrace_

masked language modeling

316 papers

Explore in graph

Also known as

MLM

Co-occurring keywords

transfer learning (5449) self-supervised learning (3777) masked language model (334) representation learning (6206) pre-trained language model (1515) text classification (6793) domain adaptation (4595) low-resource language (2273) cross-lingual transfer (1477) contrastive learning (4032)

Papers

Bridging the Gap between Recognition-level Pre-training and Commonsensical Vision-language Tasks ACL 2022
When FLUE Meets FLANG: Benchmarks and Large Pretrained Language Model for Financial Domain EMNLP 2022
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering EMNLP 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining EMNLP 2022
Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking EMNLP 2022
Subword Evenness (SuE) as a Predictor of Cross-lingual Transfer to Low-resource Languages EMNLP 2022
Text Style Transferring via Adversarial Masking and Styled Filling EMNLP 2022
Pre-training Language Models with Deterministic Factual Knowledge EMNLP 2022
Improving Few-Shot Domain Transfer for Named Entity Disambiguation with Pattern Exploitation EMNLP 2022
Capturing Topic Framing via Masked Language Modeling EMNLP 2022
Prompt-learning for Fine-grained Entity Typing EMNLP 2022
Exploring a POS-based Two-stage Approach for Improving Low-Resource AMR-to-Text Generation EMNLP 2022
Event-Based Knowledge MLM for Arabic Event Detection EMNLP 2022
HW-TSC’s Submissions to the WMT22 Word-Level Auto Completion Task EMNLP 2022
Unsupervised and Very-Low Resource Supervised Translation on German and Sorbian Variant Languages EMNLP 2022
Controllable Fake Document Infilling for Cyber Deception EMNLP 2022
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token EMNLP 2022
SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation EMNLP 2022
You Are My Type! Type Embeddings for Pre-trained Language Models EMNLP 2022
Training and Inference on Any-Order Autoregressive Models the Right Way NIPS 2022
Foundation Posteriors for Approximate Probabilistic Inference NIPS 2022
Phrase-aware Unsupervised Constituency Parsing ACL 2022
How does the pre-training objective affect what large language models learn about linguistic properties? ACL 2022
Language Models as Context-sensitive Word Search Engines ACL 2022
Large-Scale Differentially Private BERT EMNLP 2022