Multimodal Learning

AVFormer: Injecting Vision Into Frozen Speech Models for Zero-Shot AV-ASR CVPR 2023 AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis NeurIPS 2023 AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation ACL 2023 Bayesian Cross-Modal Alignment Learning for Few-Shot Out-of-Distribution Generalization AAAI 2023 Benchmarking Robustness of Adaptation Methods on Pre-trained Vision-Language Models NeurIPS 2023 Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models EMNLP 2023 BEV@DC: Bird's-Eye View Assisted Training for Depth Completion CVPR 2023 Beyond Unimodal: Generalising Neural Processes for Multimodal Uncertainty Estimation NeurIPS 2023 BIC: Twitter Bot Detection with Text-Graph Interaction and Semantic Consistency ACL 2023 BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translation ACL 2023 Bi-LRFusion: Bi-Directional LiDAR-Radar Fusion for 3D Dynamic Object Detection CVPR 2023 BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associations EMNLP 2023 Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation EMNLP 2023 Bootstrapping Multi-View Representations for Fake News Detection AAAI 2023 Bootstrapping Vision-Language Learning with Decoupled Language Pre-training NeurIPS 2023 BridgeTower: Building Bridges between Encoders in Vision-Language Representation Learning AAAI 2023 Bridging Search Region Interaction With Template for RGB-T Tracking CVPR 2023 Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation EMNLP 2023 Calibrating Multimodal Learning ICML 2023 Can you Summarize my learnings? Towards Perspective-based Educational Dialogue Summarization EMNLP 2023 Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval? CVPR 2023 Category-Extensible Out-of-Distribution Detection via Hierarchical Context Descriptions NeurIPS 2023 Causal Intervention and Counterfactual Reasoning for Multi-modal Fake News Detection ACL 2023 CCIM: Cross-modal Cross-lingual Interactive Image Translation EMNLP 2023 CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training ACL 2023