conftrace_

domain-specific pretraining

18 papers

Explore in graph

Co-occurring keywords

domain adaptation (4595) pretrained language model (1030) language model (4599) named entity recognition (2813) biomedical language model (33) text generation (2913) domain-specific pre-training (16) large language model (13587) biomedical text (175) bert model (333)

Papers

Overlapping Context with Variable-Length Stride Increases Diversity when Training Large Language Model for Code ACL 2025
𝛿-Stance: A Large-Scale Real World Dataset of Stances in Legal Argumentation ACL 2025
FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models ACL 2024
PrivaT5: A Generative Language Model for Privacy Policies ACL 2024
Once Read is Enough: Domain-specific Pretraining-free Language Models with Cluster-guided Sparse Experts for Long-tail Domain Knowledge NIPS 2024
BeanCounter: A low-toxicity, large-scale, and open dataset of business-oriented text NIPS 2024
Jargon: A Suite of Language Models and Evaluation Tasks for French Specialized Domains COLING 2024
PD-AR at ArAIEval Shared Task: A BERT-Centric Approach to Tackle Arabic Disinformation EMNLP 2023
Exploiting Language Characteristics for Legal Domain-Specific Language Model Pretraining EACL 2023
DarkBERT: A Language Model for the Dark Side of the Internet ACL 2023
AliBERT: A Pre-trained Language Model for French Biomedical Text ACL 2023
AgriBERT: Knowledge-Infused Agricultural Language Models for Matching Food and Nutrition IJCAI 2022
Towards Improved Distantly Supervised Multilingual Named-Entity Recognition for Tweets EMNLP 2022
Pretrained Biomedical Language Models for Clinical NLP in Spanish ACL 2022
A Japanese Masked Language Model for Academic Domain COLING 2022
BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model ACL 2022
CancerEmo: A Dataset for Fine-Grained Emotion Detection EMNLP 2020
Recognizing UMLS Semantic Types with Deep Learning EMNLP 2019