conftrace_

masked language modeling

316 papers

Explore in graph

Also known as

MLM

Co-occurring keywords

transfer learning (5449) self-supervised learning (3777) masked language model (334) representation learning (6206) pre-trained language model (1515) text classification (6793) domain adaptation (4595) low-resource language (2273) cross-lingual transfer (1477) contrastive learning (4032)

Papers

Comparing domain-specific and domain-general BERT variants for inferred real-world knowledge through rare grammatical features in Serbian EACL 2023
Fine-Grained Position Helps Memorizing More, a Novel Music Compound Transformer Model with Feature Interaction Fusion AAAI 2023
UMLS-KGI-BERT: Data-Centric Knowledge Integration in Transformers for Biomedical Entity Recognition ACL 2023
Learning Better Masking for Better Language Model Pre-training ACL 2023
Headline Token-based Discriminative Learning for Subheading Generation in News Article EACL 2023
Plausible May Not Be Faithful: Probing Object Hallucination in Vision-Language Pre-training EACL 2023
LayoutMask: Enhance Text-Layout Interaction in Multi-modal Pre-training for Document Understanding ACL 2023
DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning NIPS 2023
Text Style Transfer for Bias Mitigation using Masked Language Modeling NAACL 2022
MOVER: Mask, Over-generate and Rank for Hyperbole Generation NAACL 2022
Capturing Topic Framing via Masked Language Modeling EMNLP 2022
Prompt-learning for Fine-grained Entity Typing EMNLP 2022
Self-Supervised Intermediate Fine-Tuning of Biomedical Language Models for Interpreting Patient Case Descriptions COLING 2022
Pre-training Language Models with Deterministic Factual Knowledge EMNLP 2022
Improving Few-Shot Domain Transfer for Named Entity Disambiguation with Pattern Exploitation EMNLP 2022
Exploring a POS-based Two-stage Approach for Improving Low-Resource AMR-to-Text Generation EMNLP 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining EMNLP 2022
IIGROUP Submissions for WMT22 Word-Level AutoCompletion Task EMNLP 2022
Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking EMNLP 2022
When FLUE Meets FLANG: Benchmarks and Large Pretrained Language Model for Financial Domain EMNLP 2022
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering EMNLP 2022
Subword Evenness (SuE) as a Predictor of Cross-lingual Transfer to Low-resource Languages EMNLP 2022
Effective Pretraining Objectives for Transformer-based Autoencoders EMNLP 2022
Towards Unified Prompt Tuning for Few-shot Text Classification EMNLP 2022
Conditioned Masked Language and Image Modeling for Image-Text Dense Retrieval EMNLP 2022