conftrace_

downstream performance

31 papers

Explore in graph

Co-occurring keywords

language model (4599) large language model (13587) representation learning (6206) scaling law (120) transfer learning (5449) masked language modeling (316) self-supervised learning (3777) pretrained model (292) pretrained language model (1030) text compression (27)

Papers

Investigating the Role of Negatives in Contrastive Representation Learning AISTATS 2022
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora ACL 2022
On the Impact of Data Augmentation on Downstream Performance in Natural Language Processing ACL 2022
How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns NAACL 2022
Exploring the Role of Task Transferability in Large-Scale Multi-Task Learning NAACL 2022
On the Downstream Performance of Compressed Word Embeddings NIPS 2019