conftrace_

masked language modeling

303 papers

Explore in graph

Also known as

MLM

Co-occurring keywords · papers mentioning both

transfer learning (33) self-supervised learning (31) representation learning (28) pre-trained language model (27) masked language model (24) domain adaptation (20) text classification (19) multimodal learning (17) contrastive learning (17) low-resource language (16)

Papers

Improve Dense Passage Retrieval with Entailment Tuning EMNLP 2024 Integrating Quasi-symbolic Conceptual Knowledge into Language Model Pre-training CoNLL 2024 ISDS-NLP at SemEval-2024 Task 10: Transformer based neural networks for emotion recognition in conversations SemEval 2024 KidLM: Advancing Language Models for Children – Early Insights and Future Directions EMNLP 2024 Knowledge-enhanced Prompt Tuning for Dialogue-based Relation Extraction with Trigger and Label Semantic COLING 2024 L3Masking: Multi-task Fine-tuning for Language Models by Leveraging Lessons Learned from Vanilla Models EMNLP 2024 MASIVE: Open-Ended Affective State Identification in English and Spanish EMNLP 2024 MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training ICLR 2024 NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long Documents ACL 2024 Promises and Pitfalls of Generative Masked Language Modeling: Theoretical Framework and Practical Guidelines ICML 2024 Representation Deficiency in Masked Language Modeling ICLR 2024 Simple and Effective Masked Diffusion Language Models NeurIPS 2024 SPRING Lab IITM’s Submission to Low Resource Indic Language Translation Shared Task EMNLP 2024 SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining CVPR 2024 UEGP: Unified Expert-Guided Pre-training for Knowledge Rekindle NAACL 2024 Using Curriculum Masking Based on Child Language Development to Train a Large Language Model with Limited Training Data CoNLL 2024 VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation AAAI 2024 Absolute Position Embedding Learns Sinusoid-like Waves for Attention Based on Relative Position EMNLP 2023 Accelerating Vision-Language Pretraining With Free Language Modeling CVPR 2023 APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning ACL 2023 AxomiyaBERTa: A Phonologically-aware Transformer Model for Assamese ACL 2023 BERTwich: Extending BERT’s Capabilities to Model Dialectal and Noisy Text EMNLP 2023 Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning ACL 2023 Bidirectional Language Models Are Also Few-shot Learners ICLR 2023 Bidirectional Transformer Reranker for Grammatical Error Correction ACL 2023