Research Explorer
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Achievements
About
Methodology
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
RadLing: Towards Efficient Radiology Report Understanding
ACL 2023
Masked Latent Semantic Modeling: an Efficient Pre-training Alternative to Masked Language Modeling
ACL 2023
MEGClass: Extremely Weakly Supervised Text Classification via Mutually-Enhancing Text Granularities
EMNLP 2023
LayoutMask: Enhance Text-Layout Interaction in Multi-modal Pre-training for Document Understanding
ACL 2023
Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding
ACL 2023
RSVP: Customer Intent Detection via Agent Response Contrastive and Generative Pre-Training
EMNLP 2023
TSTR: Target Similarity Tuning Meets the Real World
EMNLP 2023
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
EMNLP 2023
Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models
EMNLP 2023
SELFOOD: Self-Supervised Out-Of-Distribution Detection via Learning to Rank
EMNLP 2023
Learning from Children: Improving Image-Caption Pretraining via Curriculum
ACL 2023
Contrastive Learning-based Sentence Encoders Implicitly Weight Informative Words
EMNLP 2023
Knowledgeable Parameter Efficient Tuning Network for Commonsense Question Answering
ACL 2023
ConPrompt: Pre-training a Language Model with Machine-Generated Data for Implicit Hate Speech Detection
EMNLP 2023
Position-Guided Text Prompt for Vision-Language Pre-Training
CVPR 2023
A Meta-dataset of German Medical Corpora: Harmonization of Annotations and Cross-corpus NER Evaluation
ACL 2023
Unleashing the Power of Language Models in Text-Attributed Graph
EMNLP 2023
Automatic Pronunciation Assessment - A Review
EMNLP 2023
ProD: Prompting-To-Disentangle Domain Knowledge for Cross-Domain Few-Shot Image Classification
CVPR 2023
Few-shot Unified Question Answering: Tuning Models or Prompts?
EMNLP 2023
Frequency Balanced Datasets Lead to Better Language Models
EMNLP 2023
Decomposed Prompt Tuning via Low-Rank Reparameterization
EMNLP 2023
RIGA at SemEval-2023 Task 2: NER Enhanced with GPT-3
SEMEVAL 2023
The MALACH Corpus: Results with End-to-End Architectures and Pretraining
INTERSPEECH 2023
TRIP: Accelerating Document-level Multilingual Pre-training via Triangular Document-level Pre-training on Parallel Data Triplets
EMNLP 2023
<
1
…
39
40
41
…
99
>