domain-adaptive pre-training

Is Micro Domain-Adaptive Pre-Training Effective for Real-World Operations? Multi-Step Evaluation Reveals Potential and Bottlenecks EACL 2026 Stochastic Gradient Descenders at SemEval-2026 Task 9: Few-Shot LLM Prompting for Polarization Type Classification SemEval 2026 BIRD: Bronze Inscription Restoration and Dating EMNLP 2025 DoMIX: An Efficient Framework for Exploiting Domain Knowledge in Fine-Tuning ACL 2025 PerceptionLab at BLP-2025 Task 1: Domain-Adapted BERT for Bangla Hate Speech Detection: Contrasting Single-Shot and Hierarchical Multiclass Classification AACL 2025 Reasoning-Enhanced Domain-Adaptive Pretraining of Multimodal Large Language Models for Short Video Content Governance EMNLP 2025 Chinese MentalBERT: Domain-Adaptive Pre-training on Social Media for Chinese Mental Health Text Analysis ACL 2024 How Far Is Too Far? Studying the Effects of Domain Discrepancy on Masked Language Models COLING 2024 Medical Adaptation of Large Language and Vision-Language Models: Are We Making Progress? EMNLP 2024 Attention at SemEval-2023 Task 10: Explainable Detection of Online Sexism (EDOS) SemEval 2023 Continual Pre-training of Language Models ICLR 2023 Do not Mask Randomly: Effective Domain-adaptive Pre-training by Masking In-domain Keywords ACL 2023 ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain ACL 2023 iREL at SemEval-2023 Task 10: Multi-level Training for Explainable Detection of Online Sexism SemEval 2023 LCT-1 at SemEval-2023 Task 10: Pre-training and Multi-task Learning for Sexism Detection and Classification SemEval 2023 shs-nlp at RadSum23: Domain-Adaptive Pre-training of Instruction-tuned LLMs for Radiology Report Impression Generation ACL 2023 Adapting a Language Model While Preserving its General Knowledge EMNLP 2022 G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks EMNLP 2022 Domain-Adaptive Pretraining Methods for Dialogue Understanding ACL 2021 mDAPT: Multilingual Domain Adaptive Pretraining in a Single Model EMNLP 2021 Multi-Modal Open-Domain Dialogue EMNLP 2021 When does Further Pre-training MLM Help? An Empirical Study on Task-Oriented Dialog Pre-training EMNLP 2021 Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks ACL 2020 Zero-Shot Entity Linking by Reading Entity Descriptions ACL 2019