Multimodal Learning

In-context Learning for Few-shot Multimodal Named Entity Recognition EMNLP 2023 Incorporating Structured Representations into Pretrained Vision & Language Models Using Scene Graphs EMNLP 2023 Inferential Knowledge-Enhanced Integrated Reasoning for Video Question Answering AAAI 2023 Injecting Multimodal Information into Rigid Protein Docking via Bi-level Optimization NeurIPS 2023 InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning NeurIPS 2023 Intelligent Knee Sleeves: A Real-time Multimodal Dataset for 3D Lower Body Motion Estimation Using Smart Textile NeurIPS 2023 Interactive Image Manipulation With Complex Text Instructions WACV 2023 Intuitive Multilingual Audio-Visual Speech Recognition with a Single-Trained Model EMNLP 2023 It’s not Sexually Suggestive; It’s Educative | Separating Sex Education from Suggestive Content on TikTok videos ACL 2023 JAMFN: Joint Attention Multi-Scale Fusion Network for Depression Detection Interspeech 2023 Jointly Learning Visual and Auditory Speech Representations from Raw Data ICLR 2023 Joint Semantic and Strategy Matching for Persuasive Dialogue EMNLP 2023 JourneyDB: A Benchmark for Generative Image Understanding NeurIPS 2023 KeFVP: Knowledge-enhanced Financial Volatility Prediction EMNLP 2023 Knowledge Acquisition for Human-In-The-Loop Image Captioning AISTATS 2023 Knowledge-Constrained Answer Generation for Open-Ended Video Question Answering AAAI 2023 KU-DMIS-MSRA at RadSum23: Pre-trained Vision-Language Model for Radiology Report Summarization ACL 2023 LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction Following EMNLP 2023 LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark NeurIPS 2023 Language-Assisted 3D Feature Learning for Semantic Scene Understanding AAAI 2023 Language-driven Scene Synthesis using Multi-conditional Diffusion Model NeurIPS 2023 Language-Guided Music Recommendation for Video via Prompt Analogies CVPR 2023 Language-specific Boundary Learning for Improving Mandarin-English Code-switching Speech Recognition Interspeech 2023 LASP: Text-to-Text Optimization for Language-Aware Soft Prompting of Vision & Language Models CVPR 2023 Layer-wise Fusion with Modality Independence Modeling for Multi-modal Emotion Recognition ACL 2023