Multimodal Learning

Q: How To Specialize Large Vision-Language Models to Data-Scarce VQA Tasks? A: Self-Train on Unlabeled Images! CVPR 2023 QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation CVPR 2023 Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework NeurIPS 2023 Quantifying the redundancy between prosody and text EMNLP 2023 Query-aware Multi-modal based Ranking Relevance in Video Search EMNLP 2023 Query Based Acoustic Summarization for Podcasts Interspeech 2023 Query-based Image Captioning from Multi-context 360cdegree Images EMNLP 2023 Question Generation Using Sequence-to-Sequence Model with Semantic Role Labels EACL 2023 R2H: Building Multimodal Navigation Helpers that Respond to Help Requests EMNLP 2023 Radiology Reports Improve Visual Representations Learned from Radiographs MIDL 2023 RAD-MMM: Multilingual Multiaccented Multispeaker Text To Speech Interspeech 2023 Rahul Patil at SemEval-2023 Task 1: V-WSD: Visual Word Sense Disambiguation SemEval 2023 Random Forest Classification of Breathing Phases from Audio Signals Recorded using Mobile Devices Interspeech 2023 ReactioNet: Learning High-Order Facial Behavior from Universal Stimulus-Reaction by Dyadic Relation Reasoning ICCV 2023 Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking EACL 2023 Reading Books is Great, But Not if You Are Driving! Visually Grounded Reasoning about Defeasible Commonsense Norms EMNLP 2023 Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction EMNLP 2023 Read-only Prompt Optimization for Vision-Language Few-shot Learning ICCV 2023 RealImpact: A Dataset of Impact Sound Fields for Real Objects CVPR 2023 Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modeling ICCV 2023 Real-Time Neural Rasterization for Large Scenes ICCV 2023 Reassessing Evaluation Practices in Visual Question Answering: A Case Study on Out-of-Distribution Generalization EACL 2023 Recipe2Video: Synthesizing Personalized Videos From Recipe Texts WACV 2023 Reconstruct Before Summarize: An Efficient Two-Step Framework for Condensing and Summarizing Meeting Transcripts EMNLP 2023 Reconstructing Animatable Categories From Videos CVPR 2023