Pretraining

MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining NeurIPS 2023 mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video ICML 2023 mPMR: A Multilingual Pre-trained Machine Reader at Scale ACL 2023 MRM: Masked Relation Modeling for Medical Image Pre-Training with Genetics ICCV 2023 Multi-Document Summarization with Centroid-Based Pretraining ACL 2023 Multi-domain Summarization from Leaderboards to Practice: Re-examining Automatic and Human Evaluation EMNLP 2023 MultiFusion: Fusing Pre-Trained Models for Multi-Lingual, Multi-Modal Image Generation NeurIPS 2023 Multi-level Protein Structure Pre-training via Prompt Learning ICLR 2023 Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text NeurIPS 2023 Multimodal Prompting With Missing Modalities for Visual Recognition CVPR 2023 Multi-Modal Representation Learning With Text-Driven Soft Masks CVPR 2023 Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning CVPR 2023 Multi-Source (Pre-)Training for Cross-Domain Measurement, Unit and Context Extraction ACL 2023 Multi-target Backdoor Attacks for Code Pre-trained Models ACL 2023 Multitask Pretraining with Structured Knowledge for Text-to-SQL Generation ACL 2023 Multi-View Photometric Stereo Revisited WACV 2023 MVP: Multi-task Supervised Pre-training for Natural Language Generation ACL 2023 NarrowBERT: Accelerating Masked Language Model Pretraining and Inference ACL 2023 NAS-FM: Neural Architecture Search for Tunable and Interpretable Sound Synthesis Based on Frequency Modulation IJCAI 2023 Navigating Data Scarcity: Pretraining for Medical Utterance Classification ACL 2023 Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class-Incremental Learning ICLR 2023 Neural Data Transformer 2: Multi-context Pretraining for Neural Spiking Activity NeurIPS 2023 NeuralStagger: Accelerating Physics-constrained Neural PDE Solver with Spatial-temporal Decomposition ICML 2023 Nexus at ArAIEval Shared Task: Fine-Tuning Arabic Language Models for Propaganda and Disinformation Detection EMNLP 2023 NOTABLE: Transferable Backdoor Attacks Against Prompt-based NLP Models ACL 2023