multimodal learning

SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities EMNLP 2023 SPLIT: Stance and Persuasion Prediction with Multi-modal on Image and Textual Information EMNLP 2023 Spontaneous gestures encoded by hand positions improve language models: An Information-Theoretic motivated study ACL 2023 SPRING: Situated Conversation Agent Pretrained with Multimodal Questions from Incremental Layout Graph AAAI 2023 SQA3D: Situated Question Answering in 3D Scenes ICLR 2023 Standardizing Distress Analysis: Emotion-Driven Distress Identification and Cause Extraction (DICE) in Multimodal Online Posts EMNLP 2023 STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events NeurIPS 2023 StFX NLP at SemEval-2023 Task 1: Multimodal Encoding-based Methods for Visual Word Sense Disambiguation SemEval 2023 STOA-VLP: Spatial-Temporal Modeling of Object and Action for Video-Language Pre-training AAAI 2023 StressID: a Multimodal Dataset for Stress Identification NeurIPS 2023 Style-Aware Radiology Report Generation with RadGraph and Few-Shot Prompting EMNLP 2023 StyleTalk: One-Shot Talking Head Generation with Controllable Speaking Styles AAAI 2023 Style-transfer based Speech and Audio-visual Scene understanding for Robot Action Sequence Acquisition from Videos Interspeech 2023 Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization ACL 2023 SUMMIT: Source-Free Adaptation of Uni-Modal Models to Multi-Modal Targets ICCV 2023 Support or Refute: Analyzing the Stance of Evidence to Detect Out-of-Context Mis- and Disinformation EMNLP 2023 SWRR: Feature Map Classifier Based on Sliding Window Attention and High-Response Feature Reuse for Multimodal Emotion Recognition Interspeech 2023 Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task AAAI 2023 Symbol-LLM: Leverage Language Models for Symbolic System in Visual Human Activity Reasoning NeurIPS 2023 TableVLM: Multi-modal Pre-training for Table Structure Recognition ACL 2023 Tackling Modality Heterogeneity with Multi-View Calibration Network for Multimodal Sentiment Detection ACL 2023 Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrieval AAAI 2023 Target-Aware Spatio-Temporal Reasoning via Answering Questions in Dynamic Audio-Visual Scenarios EMNLP 2023 Task-Attentive Transformer Architecture for Continual Learning of Vision-and-Language Tasks Using Knowledge Distillation EMNLP 2023 TAVT: Towards Transferable Audio-Visual Text Generation ACL 2023