conftrace_

pretraining objective

28 papers

Explore in graph

Co-occurring keywords · papers mentioning both

masked language modeling (5) representation learning (5) self-supervised learning (4) transfer learning (4) pre-trained language model (3) language model (3) text summarization (3) language modeling (3) large language model (2) multi-token prediction (2)

Papers

Frustratingly Simple Pretraining Alternatives to Masked Language Modeling EMNLP 2021 Pretraining Methods for Dialog Context Representation Learning ACL 2019 Language Modeling Teaches You More than Translation Does: Lessons Learned Through Auxiliary Syntactic Task Analysis EMNLP 2018