self-supervised pretraining

Implicit Surface Contrastive Clustering for LiDAR Point Clouds CVPR 2023 Learning 3D Representations From 2D Pre-Trained Models via Image-to-Point Masked Autoencoders CVPR 2023 Masked Motion Predictors are Strong 3D Action Representation Learners ICCV 2023 On Data Scaling in Masked Image Modeling CVPR 2023 One-Model-Connects-All: A Unified Graph Pre-Training Model for Online Community Modeling EMNLP 2023 Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classification Interspeech 2023 Pre-Training Protein Encoder via Siamese Sequence-Structure Diffusion Trajectory Prediction NeurIPS 2023 Query-as-context Pre-training for Dense Passage Retrieval EMNLP 2023 Scalable Video Object Segmentation with Simplified Framework ICCV 2023 Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning NeurIPS 2023 SEPT: Towards Scalable and Efficient Visual Pre-training AAAI 2023 SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval ACL 2023 SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modeling NeurIPS 2023 SMART: Self-supervised Multi-task pretrAining with contRol Transformers ICLR 2023 Spoofing Attacker Also Benefits from Self-Supervised Pretrained Model Interspeech 2023 StrucTexTv2: Masked Visual-Textual Prediction for Document Image Pre-training ICLR 2023 TTIC’s Submission to WMT-SLT 23 EMNLP 2023 Uni-Mol: A Universal 3D Molecular Representation Learning Framework ICLR 2023 UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units ACL 2023 Unsupervised Object Localization with Representer Point Selection ICCV 2023 VideoMAE V2: Scaling Video Masked Autoencoders With Dual Masking CVPR 2023 Weakly-Guided Self-Supervised Pretraining for Temporal Activity Detection AAAI 2023 Yet Another Traffic Classifier: A Masked Autoencoder Based Traffic Transformer with Multi-Level Flow Representation AAAI 2023 3D Infomax improves GNNs for Molecular Property Prediction ICML 2022 Augment with Care: Contrastive Learning for Combinatorial Problems ICML 2022