masked language modeling

Biomedical Language Models are Robust to Sub-optimal Tokenization ACL 2023 Boosting Prompt-Based Self-Training With Mapping-Free Automatic Verbalizer for Multi-Class Classification EMNLP 2023 Choosing What to Mask: More Informed Masking for Multimodal Machine Translation ACL 2023 CLEVR-Implicit: A Diagnostic Dataset for Implicit Reasoning in Referring Expression Comprehension EMNLP 2023 Combining Active Learning and Task Adaptation with BERT for Cost-Effective Annotation of Social Media Datasets ACL 2023 Comparing domain-specific and domain-general BERT variants for inferred real-world knowledge through rare grammatical features in Serbian EACL 2023 Contextualized Semantic Distance between Highly Overlapped Texts ACL 2023 Cramming: Training a Language Model on a single GPU in one day. ICML 2023 Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training ACL 2023 Data-Efficient French Language Modeling with CamemBERTa ACL 2023 DiFair: A Benchmark for Disentangled Assessment of Gender Knowledge and Bias EMNLP 2023 Difference-Masking: Choosing What to Mask in Continued Pretraining EMNLP 2023 DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning NeurIPS 2023 DMLM: Descriptive Masked Language Modeling ACL 2023 Do not Mask Randomly: Effective Domain-adaptive Pre-training by Masking In-domain Keywords ACL 2023 Do Transformers Parse while Predicting the Masked Word? EMNLP 2023 Exploiting Language Characteristics for Legal Domain-Specific Language Model Pretraining EACL 2023 Fine-Grained Position Helps Memorizing More, a Novel Music Compound Transformer Model with Feature Interaction Fusion AAAI 2023 Gender-tuning: Empowering Fine-tuning for Debiasing Pre-trained Language Models ACL 2023 Headline Token-based Discriminative Learning for Subheading Generation in News Article EACL 2023 Honey, I Shrunk the Language: Language Model Behavior at Reduced Scale. ACL 2023 How does the task complexity of masked pretraining objectives affect downstream performance? ACL 2023 Improving Biomedical Entity Linking with Cross-Entity Interaction AAAI 2023 Improving Pretraining Techniques for Code-Switched NLP ACL 2023 KINLP at SemEval-2023 Task 12: Kinyarwanda Tweet Sentiment Analysis SemEval 2023