domain-specific pretraining

Fairness Beyond Performance: Revealing Reliability Disparities Across Groups in Legal NLP ACL 2025 Overlapping Context with Variable-Length Stride Increases Diversity when Training Large Language Model for Code ACL 2025 𝛿-Stance: A Large-Scale Real World Dataset of Stances in Legal Argumentation ACL 2025 BeanCounter: A low-toxicity, large-scale, and open dataset of business-oriented text NeurIPS 2024 FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models ACL 2024 Jargon: A Suite of Language Models and Evaluation Tasks for French Specialized Domains COLING 2024 Once Read is Enough: Domain-specific Pretraining-free Language Models with Cluster-guided Sparse Experts for Long-tail Domain Knowledge NeurIPS 2024 PrivaT5: A Generative Language Model for Privacy Policies ACL 2024 AliBERT: A Pre-trained Language Model for French Biomedical Text ACL 2023 COVID-19 Vaccine Misinformation in Middle Income Countries EMNLP 2023 DarkBERT: A Language Model for the Dark Side of the Internet ACL 2023 Exploiting Language Characteristics for Legal Domain-Specific Language Model Pretraining EACL 2023 PD-AR at ArAIEval Shared Task: A BERT-Centric Approach to Tackle Arabic Disinformation EMNLP 2023 PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in English ACL 2023 AgriBERT: Knowledge-Infused Agricultural Language Models for Matching Food and Nutrition IJCAI 2022 A Japanese Masked Language Model for Academic Domain COLING 2022 Bernice: A Multilingual Pre-trained Encoder for Twitter EMNLP 2022 BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model ACL 2022 G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks EMNLP 2022 Pretrained Biomedical Language Models for Clinical NLP in Spanish ACL 2022 Towards Improved Distantly Supervised Multilingual Named-Entity Recognition for Tweets EMNLP 2022 AStarTwice at SemEval-2021 Task 5: Toxic Span Detection Using RoBERTa-CRF, Domain Specific Pre-Training and Self-Training SemEval 2021 cs60075_team2 at SemEval-2021 Task 1 : Lexical Complexity Prediction using Transformer-based Language Models pre-trained on various text corpora SemEval 2021 CancerEmo: A Dataset for Fine-Grained Emotion Detection EMNLP 2020 LEGAL-BERT: The Muppets straight out of Law School EMNLP 2020