cross-modal learning

Visual Hallucination Elevates Speech Recognition AAAI 2024 Weakly Misalignment-free Adaptive Feature Alignment for UAVs-based Multimodal Object Detection CVPR 2024 What Do Language Models Hear? Probing for Auditory Representations in Language Models ACL 2024 X4D-SceneFormer: Enhanced Scene Understanding on 4D Point Cloud Videos through Cross-Modal Knowledge Transfer AAAI 2024 XMask3D: Cross-modal Mask Reasoning for Open Vocabulary 3D Semantic Segmentation NeurIPS 2024 Accommodating Audio Modality in CLIP for Multimodal Processing AAAI 2023 Acoustic NLOS Imaging with Cross Modal Knowledge Distillation IJCAI 2023 Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding EMNLP 2023 A Simple Concatenation can Effectively Improve Speech Translation ACL 2023 AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanism ICCV 2023 Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning? ICLR 2023 BEV-DG: Cross-Modal Learning under Bird's-Eye View for Domain Generalization of 3D Semantic Segmentation ICCV 2023 BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection ICLR 2023 Bidirectional Cross-Modal Knowledge Exploration for Video Recognition With Pre-Trained Vision-Language Models CVPR 2023 BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translation ACL 2023 BirdSoundsDenoising: Deep Visual Audio Denoising for Bird Sounds WACV 2023 C2ST: Cross-Modal Contextualized Sequence Transduction for Continuous Sign Language Recognition ICCV 2023 CAPro: Webly Supervised Learning with Cross-modality Aligned Prototypes NeurIPS 2023 CCIM: Cross-modal Cross-lingual Interactive Image Translation EMNLP 2023 CIF-PT: Bridging Speech and Text Representations for Spoken Language Understanding via Continuous Integrate-and-Fire Pre-Training ACL 2023 CKDST: Comprehensively and Effectively Distill Knowledge from Machine Translation to End-to-End Speech Translation ACL 2023 CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training ACL 2023 CLIP-ReID: Exploiting Vision-Language Model for Image Re-identification without Concrete Text Labels AAAI 2023 CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Alignment ICLR 2023 CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentation ICCV 2023