Research Explorer
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Achievements
About
Methodology
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
LastResort at SemEval-2022 Task 5: Towards Misogyny Identification using Visual Linguistic Model Ensembles And Task-Specific Pretraining
NAACL 2022
UMUTeam at SemEval-2022 Task 5: Combining image and textual embeddings for multi-modal automatic misogyny identification
NAACL 2022
YMAI at SemEval-2022 Task 5: Detecting Misogyny in Memes using VisualBERT and MMBT MultiModal Pre-trained Models
NAACL 2022
I2C at SemEval-2022 Task 6: Intended Sarcasm in English using Deep Learning Techniques
NAACL 2022
I2C at SemEval-2022 Task 6: Intended Sarcasm Detection on Social Networks with Deep Learning
NAACL 2022
AlexU-AL at SemEval-2022 Task 6: Detecting Sarcasm in Arabic Text Using Deep Learning Techniques
NAACL 2022
IISERB Brains at SemEval-2022 Task 6: A Deep-learning Framework to Identify Intended Sarcasm in English
NAACL 2022
ITNLP2022 at SemEval-2022 Task 8: Pre-trained Model with Data Augmentation and Voting for Multilingual News Similarity
NAACL 2022
drsphelps at SemEval-2022 Task 2: Learning idiom representations using BERTRAM
NAACL 2022
SRCB at SemEval-2022 Task 5: Pretraining Based Image to Text Late Sequential Fusion System for Multimodal Misogynous Meme Identification
NAACL 2022
TeamOtter at SemEval-2022 Task 5: Detecting Misogynistic Content in Multimodal Memes
NAACL 2022
The SIGTYP 2022 Shared Task on the Prediction of Cognate Reflexes
NAACL 2022
Distributional properties of political dogwhistle representations in Swedish BERT
NAACL 2022
Choose Your Lenses: Flaws in Gender Bias Evaluation
NAACL 2022
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering
NAACL 2022
Pretrained Models for Multilingual Federated Learning
NAACL 2022
Staged Training for Transformer Language Models
ICML 2022
Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance
ICML 2022
Image-text Retrieval: A Survey on Recent Research and Development
IJCAI 2022
Vision-and-Language Pretrained Models: A Survey
IJCAI 2022
Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code
IJCAI 2022
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning
IJCAI 2022
S2SNet: A Pretrained Neural Network for Superconductivity Discovery
IJCAI 2022
AgriBERT: Knowledge-Infused Agricultural Language Models for Matching Food and Nutrition
IJCAI 2022
Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks
IJCAI 2022
<
1
…
63
64
65
…
99
>