conftrace_
← Techniques
Deep Learning › Techniques ›

Pretraining

2,483 papers

Papers per year

1
5
219
374
'10
'15
'20
'25

Papers

When Do You Need Billions of Words of Pretraining Data? IJCNLP 2021
ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information IJCNLP 2021
Optimizing Deeper Transformers on Small Datasets IJCNLP 2021
LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding IJCNLP 2021
UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning IJCNLP 2021
Few-Shot Question Answering by Pretraining Span Selection IJCNLP 2021
Making Pre-trained Language Models Better Few-shot Learners IJCNLP 2021
Psycholinguistic Tripartite Graph Network for Personality Detection IJCNLP 2021
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models IJCNLP 2021
Are Pretrained Convolutions Better than Pretrained Transformers? IJCNLP 2021
HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalizability IJCNLP 2021
SemFace: Pre-training Encoder and Decoder with a Semantic Interface for Neural Machine Translation IJCNLP 2021
How to Adapt Your Pretrained Multilingual Model to 1600 Languages IJCNLP 2021
Pre-training Universal Language Representation IJCNLP 2021
Syntax-Enhanced Pre-trained Model IJCNLP 2021
Transfer Learning for Sequence Generation: from Single-source to Multi-source IJCNLP 2021
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization IJCNLP 2021
Thank you BART! Rewarding Pre-Trained Models Improves Formality Style Transfer IJCNLP 2021
Domain-Adaptive Pretraining Methods for Dialogue Understanding IJCNLP 2021
BERTTune: Fine-Tuning Neural Machine Translation with BERTScore IJCNLP 2021
Stage-wise Fine-tuning for Graph-to-Text Generation IJCNLP 2021
Long Document Summarization in a Low Resource Setting using Pretrained Language Models IJCNLP 2021
Attending Self-Attention: A Case Study of Visually Grounded Supervision in Vision-and-Language Transformers IJCNLP 2021
Predicting pragmatic discourse features in the language of adults with autism spectrum disorder IJCNLP 2021
Team “NoConflict” at CASE 2021 Task 1: Pretraining for Sentence-Level Protest Event Detection IJCNLP 2021