cross-modal learning

ProtT3: Protein-to-Text Generation for Text-based Protein Understanding ACL 2024 R^2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding ECCV 2024 Rethinking Two-Stage Referring Expression Comprehension: A Novel Grounding and Segmentation Method Modulated by Point AAAI 2024 See Detail Say Clear: Towards Brain CT Report Generation via Pathological Clue-driven Representation Learning EMNLP 2024 Shallow-Deep Collaborative Learning for Unsupervised Visible-Infrared Person Re-Identification CVPR 2024 Speech Recognition Models are Strong Lip-readers Interspeech 2024 Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLM ICLR 2024 SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization Interspeech 2024 TARN-VIST: Topic Aware Reinforcement Network for Visual Storytelling COLING 2024 Tell Me What Is Good about This Property: Leveraging Reviews for Segment-Personalized Image Collection Summarization AAAI 2024 Text-Guided Face Recognition Using Multi-Granularity Cross-Modal Contrastive Learning WACV 2024 Text-Infused Attention and Foreground-Aware Modeling for Zero-Shot Temporal Action Detection NeurIPS 2024 THInImg: Cross-Modal Steganography for Presenting Talking Heads in Images WACV 2024 Towards 3D Molecule-Text Interpretation in Language Models ICLR 2024 Towards Multi-modal Sarcasm Detection via Disentangled Multi-grained Multi-modal Distilling COLING 2024 Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems ACL 2024 UFineBench: Towards Text-based Person Retrieval with Ultra-fine Granularity CVPR 2024 Uncertainty-Aware Cross-Modal Alignment for Hate Speech Detection COLING 2024 UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling ICLR 2024 UniAudio 1.5: Large Language Model-Driven Audio Codec is A Few-Shot Audio Task Learner NeurIPS 2024 Unraveling Instance Associations: A Closer Look for Audio-Visual Segmentation CVPR 2024 VideoCLIP-XL: Advancing Long Description Understanding for Video CLIP Models EMNLP 2024 Video Event Extraction with Multi-View Interaction Knowledge Distillation AAAI 2024 Visible-Infrared Person Re-Indentification via Feature Fusion and Deep Mutual Learning ACML 2024 Vision-and-Language Navigation via Causal Learning CVPR 2024