Research Explorer
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Achievements
About
Methodology
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
Improving Fractal Pre-Training
WACV 2022
Self-Supervised Pretraining Improves Self-Supervised Pretraining
WACV 2022
Self-Supervised Shape Alignment for Sports Field Registration
WACV 2022
A-TIP: Attribute-aware Text Infilling via Pre-trained Language Model
COLING 2022
Graph-to-Text Generation with Dynamic Structure Pruning
COLING 2022
NCUEE-NLP@SMM4H’22: Classification of Self-reported Chronic Stress on Twitter Using Ensemble Pre-trained Transformer Models
COLING 2022
Translating Spanish into Spanish Sign Language: Combining Rules and Data-driven Approaches
COLING 2022
CAISA@SMM4H’22: Robust Cross-Lingual Detection of Disease Mentions on Social Media with Adversarial Methods
COLING 2022
Improving Jejueo-Korean Translation With Cross-Lingual Pretraining Using Japanese and Korean
COLING 2022
Efficient Multilingual Multi-modal Pre-training through Triple Contrastive Loss
COLING 2022
A Unified Representation and a Decoupled Deep Learning Architecture for Argumentation Mining of Students’ Persuasive Essays
COLING 2022
Silo NLP’s Participation at WAT2022
COLING 2022
CIC NLP at SMM4H 2022: a BERT-based approach for classification of social media forum posts
COLING 2022
Semantic-based Pre-training for Dialogue Understanding
COLING 2022
PromptGen: Automatically Generate Prompts using Generative Models
NAACL 2022
MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving
NAACL 2022
CODE-MVP: Learning to Represent Source Code from Multiple Views with Contrastive Pre-Training
NAACL 2022
KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation
NAACL 2022
UoR-NCL at SemEval-2022 Task 3: Fine-Tuning the BERT-Based Models for Validating Taxonomic Relations
NAACL 2022
UU-Tax at SemEval-2022 Task 3: Improving the generalizability of language models for taxonomy classification through data augmentation
NAACL 2022
KaMiKla at SemEval-2022 Task 3: AlBERTo, BERT, and CamemBERT—Be(r)tween Taxonomy Detection and Prediction
NAACL 2022
JUST-DEEP at SemEval-2022 Task 4: Using Deep Learning Techniques to Reveal Patronizing and Condescending Language
NAACL 2022
I2C at SemEval-2022 Task 4: Patronizing and Condescending Language Detection using Deep Learning Techniques
NAACL 2022
Xu at SemEval-2022 Task 4: Pre-BERT Neural Network Methods vs Post-BERT RoBERTa Approach for Patronizing and Condescending Language Detection
NAACL 2022
Amsqr at SemEval-2022 Task 4: Towards AutoNLP via Meta-Learning and Adversarial Data Augmentation for PCL Detection
NAACL 2022
<
1
…
62
63
64
…
99
>