← Keywords

cross-modal learning

521 papers

Explore in graph

Also known as

CMP C3HOST

Co-occurring keywords

multimodal learning (4622) contrastive learning (3979) knowledge distillation (3680) representation learning (6174) multi-modal learning (1276) vision-language model (2235) self-supervised learning (3751) domain adaptation (4578) video understanding (1647) zero-shot learning (3637)

Papers

SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training EMNLP 2022
Visual Acoustic Matching CVPR 2022
Negative-Aware Attention Framework for Image-Text Matching CVPR 2022
Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation CVPR 2022
UniXcoder: Unified Cross-Modal Pre-training for Code Representation ACL 2022
XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding ACL 2022
Attention as Grounding: Exploring Textual and Cross-Modal Attention on Entities and Relations in Language-and-Vision Transformer ACL 2022
Amazon Alexa AI’s System for IWSLT 2022 Offline Speech Translation Shared Task ACL 2022
Cross-Modal Adversarial Reprogramming WACV 2022
Unsupervised Voice-Face Representation Learning by Cross-Modal Prototype Contrast IJCAI 2022
Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading AAAI 2022
FLAVA: A Foundational Language and Vision Alignment Model CVPR 2022
Low-Resource Adaptation for Personalized Co-Speech Gesture Generation CVPR 2022
Text2Pos: Text-to-Point-Cloud Cross-Modal Localization CVPR 2022
Cross-modal Contrastive Attention Model for Medical Report Generation COLING 2022
Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection CVPR 2022
Decoupling and Recoupling Spatiotemporal Representation for RGB-D-Based Motion Recognition CVPR 2022
Word-wise Sparse Attention for Multimodal Sentiment Analysis INTERSPEECH 2022
Leveraging Acoustic Contextual Representation by Audio-textual Cross-modal Learning for Conversational ASR INTERSPEECH 2022
Cross-Modal Representation Learning for Zero-Shot Action Recognition CVPR 2022
Towards Language-Free Training for Text-to-Image Generation CVPR 2022
Vision-Language Pre-Training for Boosting Scene Text Detectors CVPR 2022
Let Images Give You More: Point Cloud Cross-Modal Training for Shape Analysis NIPS 2022
Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmark NIPS 2022
Cross-Modal Coherence for Text-to-Image Retrieval AAAI 2022