← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Techniques for Symbol Grounding with SATNet NIPS 2021
Counts@IITK at SemEval-2021 Task 8: SciBERT Based Entity And Semantic Relation Extraction For Scientific Data SEMEVAL 2021
When Do You Need Billions of Words of Pretraining Data? ACL 2021
ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information ACL 2021
SkoltechNLP at SemEval-2021 Task 5: Leveraging Sentence-level Pre-training for Toxic Span Detection ACL 2021
Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threads OSDI 2021
Lips Don't Lie: A Generalisable and Robust Approach To Face Forgery Detection CVPR 2021
Lotus at SemEval-2021 Task 2: Combination of BERT and Paraphrasing for English Word Sense Disambiguation ACL 2021
MaxUp: Lightweight Adversarial Training With Data Augmentation Improves Neural Network Training CVPR 2021
DAP: Detection-Aware Pre-Training With Weak Supervision CVPR 2021
StEP: Style-Based Encoder Pre-Training for Multi-Modal Image Synthesis CVPR 2021
VirTex: Learning Visual Representations From Textual Annotations CVPR 2021
Learning Spatial-Semantic Relationship for Facial Attribute Recognition With Limited Labeled Data CVPR 2021
Light Field Super-Resolution With Zero-Shot Learning CVPR 2021
Pre-Trained Image Processing Transformer CVPR 2021
Unsupervised Learning of 3D Object Categories From Videos in the Wild CVPR 2021
TAP: Text-Aware Pre-Training for Text-VQA and Text-Caption CVPR 2021
Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition CVPR 2021
UC2: Universal Cross-Lingual Cross-Modal Vision-and-Language Pre-Training CVPR 2021
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees EACL 2021
The Effect of Pretraining on Extractive Summarization for Scientific Documents NAACL 2021
Pretrain-Finetune Based Training of Task-Oriented Dialogue Systems in a Real-World Setting NAACL 2021
Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation IJCNLP 2021
CS-UM6P at SemEval-2021 Task 1: A Deep Learning Model-based Pre-trained Transformer Encoder for Lexical Complexity SEMEVAL 2021
RoBLEURT Submission for WMT2021 Metrics Task EMNLP 2021