multimodal pretraining

A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretraining ICML 2023 Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training ACL 2023 FLIP: Cross-domain Face Anti-spoofing with Language Guidance ICCV 2023 Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks CVPR 2023 Learning Instance-Level Representation for Large-Scale Multi-Modal Pretraining in E-Commerce CVPR 2023 “Let’s not Quote out of Context”: Unified Vision-Language Pretraining for Context Assisted Image Captioning ACL 2023 Long-range Multimodal Pretraining for Movie Understanding ICCV 2023 mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video ICML 2023 TableVLM: Multi-modal Pre-training for Table Structure Recognition ACL 2023 Weakly-Supervised Learning of Visual Relations in Multimodal Pretraining EMNLP 2023 Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding ACL 2023 Advancing High-Resolution Video-Language Representation With Large-Scale Video Transcriptions CVPR 2022 ASRtrans at SemEval-2022 Task 5: Transformer-based Models for Meme Classification SemEval 2022 Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning CVPR 2022 CapOnImage: Context-driven Dense-Captioning on Image EMNLP 2022 ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding EMNLP 2022 FaD-VLP: Fashion Vision-and-Language Pre-training towards Unified Retrieval and Captioning EMNLP 2022 M5Product: Self-Harmonized Contrastive Learning for E-Commercial Multi-Modal Pretraining CVPR 2022 MarkupLM: Pre-training of Text and Markup Language for Visually Rich Document Understanding ACL 2022 Modular and Parameter-Efficient Multimodal Fusion with Prompting ACL 2022 OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework ICML 2022 Scaling Multimodal Pre-Training via Cross-Modality Gradient Harmonization NeurIPS 2022 Self-Supervised Audio-and-Text Pre-training with Extremely Low-Resource Parallel Data AAAI 2022 TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection EMNLP 2022 LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding ACL 2021