conftrace_
← Techniques
Deep Learning › Techniques ›

Pretraining

2,483 papers

Papers per year

1
5
219
374
'10
'15
'20
'25

Papers

Exploring Metaphoric Paraphrase Generation CONLL 2021
UC2: Universal Cross-Lingual Cross-Modal Vision-and-Language Pre-Training CVPR 2021
Lips Don't Lie: A Generalisable and Robust Approach To Face Forgery Detection CVPR 2021
Unsupervised Learning of 3D Object Categories From Videos in the Wild CVPR 2021
Pre-Trained Image Processing Transformer CVPR 2021
GAIA: A Transfer Learning System of Object Detection That Fits Your Needs CVPR 2021
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts CVPR 2021
Light Field Super-Resolution With Zero-Shot Learning CVPR 2021
Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition CVPR 2021
The Lottery Tickets Hypothesis for Supervised and Self-Supervised Pre-Training in Computer Vision Models CVPR 2021
Learning Spatial-Semantic Relationship for Facial Attribute Recognition With Limited Labeled Data CVPR 2021
VirTex: Learning Visual Representations From Textual Annotations CVPR 2021
StEP: Style-Based Encoder Pre-Training for Multi-Modal Image Synthesis CVPR 2021
TAP: Text-Aware Pre-Training for Text-VQA and Text-Caption CVPR 2021
DAP: Detection-Aware Pre-Training With Weak Supervision CVPR 2021
MaxUp: Lightweight Adversarial Training With Data Augmentation Improves Neural Network Training CVPR 2021
Cross-lingual Visual Pre-training for Multimodal Machine Translation EACL 2021
Data Augmentation for Voice-Assistant NLU using BERT-based Interchangeable Rephrase EACL 2021
Structural Encoding and Pre-training Matter: Adapting BERT for Table-Based Fact Verification EACL 2021
Annealing Knowledge Distillation EACL 2021
Scientific Discourse Tagging for Evidence Extraction EACL 2021
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees EACL 2021
EmpathBERT: A BERT-based Framework for Demographic-aware Empathy Prediction EACL 2021
A Little Pretraining Goes a Long Way: A Case Study on Dependency Parsing Task for Low-resource Morphologically Rich Languages EACL 2021
Multidomain Pretrained Language Models for Green NLP EACL 2021