Pretraining

Breaking Boundaries in Retrieval Systems: Unsupervised Domain Adaptation with Denoise-Finetuning EMNLP 2023 BUS: Efficient and Effective Vision-Language Pre-Training with Bottom-Up Patch Summarization. ICCV 2023 Byte Pair Encoding for Symbolic Music EMNLP 2023 CapDet: Unifying Dense Captioning and Open-World Detection Pretraining CVPR 2023 CAPSTONE: Curriculum Sampling for Dense Retrieval with Document Expansion EMNLP 2023 Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models NeurIPS 2023 Chinese Text Recognition with A Pre-Trained CLIP-Like Model Through Image-IDS Aligning ICCV 2023 CIF-PT: Bridging Speech and Text Representations for Spoken Language Understanding via Continuous Integrate-and-Fire Pre-Training ACL 2023 CLIPTER: Looking at the Bigger Picture in Scene Text Recognition ICCV 2023 CLIP the Gap: A Single Domain Generalization Approach for Object Detection CVPR 2023 Co2PT: Mitigating Bias in Pre-trained Language Models through Counterfactual Contrastive Prompt Tuning EMNLP 2023 CODA-Prompt: COntinual Decomposed Attention-Based Prompting for Rehearsal-Free Continual Learning CVPR 2023 CodeFusion: A Pre-trained Diffusion Model for Code Generation EMNLP 2023 Code-Switching with Word Senses for Pretraining in Neural Machine Translation EMNLP 2023 CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers ICLR 2023 CoMAE: Single Model Hybrid Pre-training on Small-Scale RGB-D Datasets AAAI 2023 CoMix: Guide Transformers to Code-Mix using POS structure and Phonetics ACL 2023 ConPrompt: Pre-training a Language Model with Machine-Generated Data for Implicit Hate Speech Detection EMNLP 2023 Context-Aware Alignment and Mutual Masking for 3D-Language Pre-Training CVPR 2023 Context-Aware Pretraining for Efficient Blind Image Decomposition CVPR 2023 Context-Aware Transformer Pre-Training for Answer Sentence Selection ACL 2023 Context-enriched molecule representations improve few-shot drug discovery ICLR 2023 Contextual Image Masking Modeling via Synergized Contrasting without View Augmentation for Faster and Better Visual Pretraining ICLR 2023 CONTRASTE: Supervised Contrastive Pre-training With Aspect-based Prompts For Aspect Sentiment Triplet Extraction EMNLP 2023 Contrastive Learning-based Sentence Encoders Implicitly Weight Informative Words EMNLP 2023