masked language modeling

Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More ICML 2025 Punctuation Restoration Improves Structure Understanding without Supervision NAACL 2025 Re-identification of De-identified Documents with Autoregressive Infilling ACL 2025 SATA: A Paradigm for LLM Jailbreak via Simple Assistive Task Linkage ACL 2025 ScanEZ: Integrating Cognitive Models with Self-Supervised Learning for Spatiotemporal Scanpath Prediction ACL 2025 Seamlessly Integrating Tree-Based Positional Embeddings into Transformer Models for Source Code Representation ACL 2025 T2V2: A Unified Non-Autoregressive Model for Speech Recognition and Synthesis via Multitask Learning ICLR 2025 Task-Informed Anti-Curriculum by Masking Improves Downstream Performance on Text ACL 2025 Towards Unified Human Motion-Language Understanding via Sparse Interpretable Characterization ICLR 2025 Training compute-optimal transformer encoder models EMNLP 2025 Transforming Causal LLM into MLM Encoder for Detecting Social Media Manipulation in Telegram ACL 2025 Abrupt Learning in Transformers: A Case Study on Matrix Completion NeurIPS 2024 A Language Model Trained on Uruguayan Spanish News Text COLING 2024 Automated Scoring of Clinical Patient Notes: Findings From the Kaggle Competition and Their Translation into Practice NAACL 2024 CEPT: A Contrast-Enhanced Prompt-Tuning Framework for Emotion Recognition in Conversation COLING 2024 Chinese MentalBERT: Domain-Adaptive Pre-training on Social Media for Chinese Mental Health Text Analysis ACL 2024 Curriculum Masking in Vision-Language Pretraining to Maximize Cross Modal Interaction NAACL 2024 CycleGN: A Cycle Consistent Approach for Neural Machine Translation EMNLP 2024 DDxGym: Online Transformer Policies in a Knowledge Graph Based Natural Language Environment COLING 2024 Dynamic Masking Rate Schedules for MLM Pretraining EACL 2024 Embible: Reconstruction of Ancient Hebrew and Aramaic Texts Using Transformers EACL 2024 Generating Multiple-choice Questions for Medical Question Answering with Distractors and Cue-masking COLING 2024 Getting The Most Out of Your Training Data: Exploring Unsupervised Tasks for Morphological Inflection EMNLP 2024 GPT or BERT: why not both? CoNLL 2024 Ignore Me But Don’t Replace Me: Utilizing Non-Linguistic Elements for Pretraining on the Cybersecurity Domain NAACL 2024