conftrace_
← Resources & Methods
Natural Language Processing › Resources & Methods ›

Pretraining

77 papers

Papers per year

1
6
9
10
15
18
3
10
5

Papers

Encoder and Decoder, Not One Less for Pre-trained Language Model Sponsored NMT ACL 2023
DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Models ACL 2023
IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning ACL 2023
Masked Latent Semantic Modeling: an Efficient Pre-training Alternative to Masked Language Modeling ACL 2023
Hierarchical Pretraining on Multimodal Electronic Health Records EMNLP 2023
TRIP: Accelerating Document-level Multilingual Pre-training via Triangular Document-level Pre-training on Parallel Data Triplets EMNLP 2023
Knowledge-Selective Pretraining for Attribute Value Extraction EMNLP 2023
CLMSM: A Multi-Task Learning Framework for Pre-training on Procedural Text EMNLP 2023
Balaur: Language Model Pretraining with Lexical Semantic Relations EMNLP 2023
DocSplit: Simple Contrastive Pretraining for Large Document Embeddings EMNLP 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models EMNLP 2023
SAS: Self-Augmentation Strategy for Language Model Pre-training AAAI 2022
SRL4E – Semantic Role Labeling for Emotions: A Unified Evaluation Framework ACL 2022
TextPruner: A Model Pruning Toolkit for Pre-Trained Language Models ACL 2022
Improving Relation Extraction through Syntax-induced Pre-training with Dependency Masking ACL 2022
About Time: Do Transformers Learn Temporal Verbal Aspect? ACL 2022
Using BERT Embeddings to Model Word Importance in Conversational Transcripts for Deaf and Hard of Hearing Users ACL 2022
Making Pretrained Language Models Good Long-tailed Learners EMNLP 2022
Language Contamination Helps Explains the Cross-lingual Capabilities of English Pretrained Models EMNLP 2022
G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks EMNLP 2022
Pre-training Language Models with Deterministic Factual Knowledge EMNLP 2022
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection EMNLP 2022
CogKTR: A Knowledge-Enhanced Text Representation Toolkit for Natural Language Understanding EMNLP 2022
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token EMNLP 2022
What do Large Language Models Learn beyond Language? EMNLP 2022