Multimodal Learning

AVFormer: Injecting Vision Into Frozen Speech Models for Zero-Shot AV-ASR CVPR 2023 A Video Is Worth 4096 Tokens: Verbalize Videos To Understand Them In Zero Shot EMNLP 2023 AVIS: Autonomous Visual Information Seeking with Large Language Model Agent NeurIPS 2023 AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis NeurIPS 2023 BanglaAbuseMeme: A Dataset for Bengali Abusive Meme Classification EMNLP 2023 Barlow Constrained Optimization for Visual Question Answering WACV 2023 Bayesian Networks for the robust and unbiased prediction of depression and its symptoms utilizing speech and multimodal data Interspeech 2023 BEATs: Audio Pre-Training with Acoustic Tokenizers ICML 2023 Be Everywhere - Hear Everything (BEE): Audio Scene Reconstruction by Sparse Audio-Visual Samples ICCV 2023 Benchmarking Diverse-Modal Entity Linking with Generative Models ACL 2023 Benchmarking Robustness of Adaptation Methods on Pre-trained Vision-Language Models NeurIPS 2023 Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models EMNLP 2023 Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation ICCV 2023 BEV-DG: Cross-Modal Learning under Bird's-Eye View for Domain Generalization of 3D Semantic Segmentation ICCV 2023 BEV-SAN: Accurate BEV 3D Object Detection via Slice Attention Networks CVPR 2023 Beyond Detection: A Defend-and-Summarize Strategy for Robust and Interpretable Rumor Analysis on Social Media EMNLP 2023 Beyond Flat GelSight Sensors: Simulation of Optical Tactile Sensors of Complex Morphologies for Sim2Real Learning RSS 2023 Beyond One-to-One: Rethinking the Referring Image Segmentation ICCV 2023 Beyond Unimodal: Generalising Neural Processes for Multimodal Uncertainty Estimation NeurIPS 2023 BiCro: Noisy Correspondence Rectification for Multi-Modality Data via Bi-Directional Cross-Modal Similarity Consistency CVPR 2023 BIC: Twitter Bot Detection with Text-Graph Interaction and Semantic Consistency ACL 2023 Bidirectional Cross-Modal Knowledge Exploration for Video Recognition With Pre-Trained Vision-Language Models CVPR 2023 BIG-C: a Multimodal Multi-Purpose Dataset for Bemba ACL 2023 Bi-LRFusion: Bi-Directional LiDAR-Radar Fusion for 3D Dynamic Object Detection CVPR 2023 BKinD-3D: Self-Supervised 3D Keypoint Discovery From Multi-View Videos CVPR 2023