cross-modal learning

Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation Interspeech 2023 Language Adaptive Weight Generation for Multi-Task Visual Grounding CVPR 2023 Learning Concordant Attention via Target-aware Alignment for Visible-Infrared Person Re-identification ICCV 2023 Learning Geometric-Aware Properties in 2D Representation Using Lightweight CAD Models, or Zero Real 3D Pairs CVPR 2023 Learning Semantic Alignment with Global Modality Reconstruction for Video-Language Pre-training towards Retrieval AAAI 2023 Learning Summary-Worthy Visual Representation for Abstractive Summarization in Video IJCAI 2023 Leveraging per Image-Token Consistency for Vision-Language Pre-Training CVPR 2023 MaXM: Towards Multilingual Visual Question Answering EMNLP 2023 MixReorg: Cross-Modal Mixed Patch Reorganization is a Good Mask Learner for Open-World Semantic Segmentation ICCV 2023 MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition ICCV 2023 MS-DETR: Natural Language Video Localization with Sampling Moment-Moment Interaction ACL 2023 Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning With Multimodal Models CVPR 2023 Multi-Scale Attention for Audio Question Answering Interspeech 2023 Mx2M: Masked Cross-Modality Modeling in Domain Adaptation for 3D Semantic Segmentation AAAI 2023 On the Difference of BERT-style and CLIP-style Text Encoders ACL 2023 PEIT: Bridging the Modality Gap with Pre-trained Models for End-to-End Image Translation ACL 2023 Position-Guided Text Prompt for Vision-Language Pre-Training CVPR 2023 Probability-Based Global Cross-Modal Upsampling for Pansharpening CVPR 2023 Progressive Spatio-Temporal Prototype Matching for Text-Video Retrieval ICCV 2023 PromptStyle: Controllable Style Transfer for Text-to-Speech with Natural Language Descriptions Interspeech 2023 ProtoTransfer: Cross-Modal Prototype Transfer for Point Cloud Segmentation ICCV 2023 PubMedCLIP: How Much Does CLIP Benefit Visual Question Answering in the Medical Domain? EACL 2023 Rethinking and Improving Multi-task Learning for End-to-end Speech Translation EMNLP 2023 Self-Supervised Audio-Visual Representation Learning with Relaxed Cross-Modal Synchronicity AAAI 2023 Self-Supervised Lidar Place Recognition in Overhead Imagery Using Unpaired Data RSS 2023