Research Explorer
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Achievements
About
Methodology
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
CapDet: Unifying Dense Captioning and Open-World Detection Pretraining
CVPR 2023
BERTastic at SemEval-2023 Task 3: Fine-Tuning Pretrained Multilingual Transformers Does Order Matter?
SEMEVAL 2023
Frozen Language Model Helps ECG Zero-Shot Learning
MIDL 2023
SegPrompt: Using Segmentation Map as a Better Prompt to Finetune Deep Models for Kidney Stone Classification
MIDL 2023
NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysis
ACL 2023
Genetic Prompt Search via Exploiting Language Model Probabilities
IJCAI 2023
Leveraging Domain Knowledge for Inclusive and Bias-aware Humanitarian Response Entry Classification
IJCAI 2023
Event Camera Data Pre-training
ICCV 2023
Ego-Only: Egocentric Action Detection without Exocentric Transferring
ICCV 2023
You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language Model
CVPR 2023
GeoLayoutLM: Geometric Pre-Training for Visual Information Extraction
CVPR 2023
Open-Category Human-Object Interaction Pre-Training via Language Modeling Framework
CVPR 2023
All in One: Exploring Unified Video-Language Pre-Training
CVPR 2023
LAVENDER: Unifying Video-Language Understanding As Masked Language Modeling
CVPR 2023
MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretraining
CVPR 2023
LEMaRT: Label-Efficient Masked Region Transform for Image Harmonization
CVPR 2023
Hint-Aug: Drawing Hints From Foundation Vision Transformers Towards Boosted Few-Shot Parameter-Efficient Tuning
CVPR 2023
mPMR: A Multilingual Pre-trained Machine Reader at Scale
ACL 2023
Arithmetic-Based Pretraining Improving Numeracy of Pretrained Language Models
ACL 2023
LexLIP: Lexicon-Bottlenecked Language-Image Pre-Training for Large-Scale Image-Text Sparse Retrieval
ICCV 2023
OPERA: Omni-Supervised Representation Learning with Hierarchical Supervisions
ICCV 2023
Fully Attentional Networks with Self-emerging Token Labeling
ICCV 2023
Ponder: Point Cloud Pre-training via Neural Rendering
ICCV 2023
ProTeGe: Untrimmed Pretraining for Video Temporal Grounding by Video Temporal Grounding
CVPR 2023
PromptARA: Improving Deep Representation in Hybrid Automatic Readability Assessment with Prompt and Orthogonal Projection
EMNLP 2023
<
1
…
52
53
54
…
99
>