← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimation CVPR 2023
Prompt-Guided Zero-Shot Anomaly Action Recognition Using Pretrained Deep Skeleton Features CVPR 2023
Visual Atoms: Pre-Training Vision Transformers With Sinusoidal Waves CVPR 2023
OmniMAE: Single Model Masked Pretraining on Images and Videos CVPR 2023
Mask3D: Pre-Training 2D Vision Transformers by Learning Masked 3D Priors CVPR 2023
3D Highlighter: Localizing Regions on 3D Shapes via Text Descriptions CVPR 2023
Revisiting Temporal Modeling for CLIP-Based Image-to-Video Knowledge Transferring CVPR 2023
Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning CVPR 2023
On Conditional and Compositional Language Model Differentiable Prompting IJCAI 2023
Enhancing Language Representation with Constructional Information for Natural Language Understanding ACL 2023
Revisiting non-English Text Simplification: A Unified Multilingual Benchmark ACL 2023
FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue ACL 2023
Uncovering Hidden Consequences of Pre-training Objectives in Sequence-to-Sequence Models ACL 2023
CIF-PT: Bridging Speech and Text Representations for Spoken Language Understanding via Continuous Integrate-and-Fire Pre-Training ACL 2023
An Empirical Study of Sentiment-Enhanced Pre-Training for Aspect-Based Sentiment Analysis ACL 2023
INTapt: Information-Theoretic Adversarial Prompt Tuning for Enhanced Non-Native Speech Recognition ACL 2023
Team:PULSAR at ProbSum 2023:PULSAR: Pre-training with Extracted Healthcare Terms for Summarising Patients’ Problems and Data Augmentation with Black-box Large Language Models ACL 2023
VindLU: A Recipe for Effective Video-and-Language Pretraining CVPR 2023
Reproducibility of the Methods in Medical Imaging with Deep Learning. MIDL 2023
Team QUST at SemEval-2023 Task 3: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting Online News Genre, Framing and Persuasion Techniques SEMEVAL 2023
ELiRF-VRAIN at BioNLP Task 1B: Radiology Report Summarization ACL 2023
Do not Mask Randomly: Effective Domain-adaptive Pre-training by Masking In-domain Keywords ACL 2023
FedBFPT: An Efficient Federated Learning Framework for Bert Further Pre-training IJCAI 2023
Mixed Autoencoder for Self-Supervised Visual Representation Learning CVPR 2023
Improved Distribution Matching for Dataset Condensation CVPR 2023