cross-modal alignment

NLIP: Noise-Robust Language-Image Pre-training AAAI 2023 PatchCT: Aligning Patch Set and Label Set with Conditional Transport for Multi-Label Image Classification ICCV 2023 Perceptual Structure in the absence of grounding: the impact of abstractedness and subjectivity in color language for LLMs EMNLP 2023 Pre-training for Speech Translation: CTC Meets Optimal Transport ICML 2023 Query-aware Multi-modal based Ranking Relevance in Video Search EMNLP 2023 Rethinking Multimodal Entity and Relation Extraction from a Translation Point of View ACL 2023 Revisiting Multimodal Representation in Contrastive Learning: From Patch and Token Embeddings to Finite Discrete Tokens CVPR 2023 Seeing What You Miss: Vision-Language Pre-Training With Semantic Completion Learning CVPR 2023 SMAUG: Sparse Masked Autoencoder for Efficient Video-Language Pre-Training ICCV 2023 SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentation NeurIPS 2023 Sound Source Localization is All about Cross-Modal Alignment ICCV 2023 Speech-Text Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment ACL 2023 Text Augmented Spatial Aware Zero-shot Referring Image Segmentation EMNLP 2023 Text-To-Concept (and Back) via Cross-Model Alignment ICML 2023 Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignment IJCAI 2023 TOT：Topology-Aware Optimal Transport for Multimodal Hate Detection AAAI 2023 Towards High-Fidelity Text-Guided 3D Face Generation and Manipulation Using only Images ICCV 2023 Training Simultaneous Speech Translation with Robust and Random Wait-k-Tokens Strategy EMNLP 2023 Unify, Align and Refine: Multi-Level Semantic Alignment for Radiology Report Generation ICCV 2023 Unsupervised Sounding Pixel Learning EMNLP 2023 Video Action Recognition with Attentive Semantic Units ICCV 2023 Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding EMNLP 2023 ViewCo: Discovering Text-Supervised Segmentation Masks via Multi-View Semantic Consistency ICLR 2023 WACO: Word-Aligned Contrastive Learning for Speech Translation ACL 2023 WiCo: Win-win Cooperation of Bottom-up and Top-down Referring Image Segmentation IJCAI 2023