Pretraining

Masked Image Modeling With Local Multi-Scale Reconstruction CVPR 2023 Masked Latent Semantic Modeling: an Efficient Pre-training Alternative to Masked Language Modeling ACL 2023 Masked Path Modeling for Vision-and-Language Navigation EMNLP 2023 MAST: Masked Augmentation Subspace Training for Generalizable Self-Supervised Priors ICLR 2023 Matching receptor to odorant with protein language and graph neural networks ICLR 2023 Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam ICLR 2023 mCPT at SemEval-2023 Task 3: Multilingual Label-Aware Contrastive Pre-Training of Transformers for Few- and Zero-shot Framing Detection SemEval 2023 MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training for X-ray Diagnosis ICCV 2023 Meet in the Middle: A New Pre-training Paradigm NeurIPS 2023 MEGClass: Extremely Weakly Supervised Text Classification via Mutually-Enhancing Text Granularities EMNLP 2023 MGMAE: Motion Guided Masking for Video Masked Autoencoding ICCV 2023 Misalign, Contrast then Distill: Rethinking Misalignments in Language-Image Pre-training ICCV 2023 Mixed Autoencoder for Self-Supervised Visual Representation Learning CVPR 2023 MixMAE: Mixed and Masked Autoencoder for Efficient Pretraining of Hierarchical Vision Transformers CVPR 2023 MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initialization ICLR 2023 MMSpeech: Multi-modal Multi-task Encoder-Decoder Pre-training for speech recognition Interspeech 2023 mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations EMNLP 2023 Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers ACL 2023 ModelKeeper: Accelerating DNN Training via Automated Training Warmup NSDI 2023 Modelling Political Aggression on Social Media Platforms ACL 2023 Modelling Temporal Document Sequences for Clinical ICD Coding EACL 2023 Model-tuning Via Prompts Makes NLP Models Adversarially Robust EMNLP 2023 Mole-BERT: Rethinking Pre-training Graph Neural Networks for Molecules ICLR 2023 Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matching ICLR 2023 More Than Just Attention: Improving Cross-Modal Attentions With Contrastive Constraints for Image-Text Matching WACV 2023