multimodal interaction

Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications ICLR 2024 WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences NeurIPS 2024 Let's Give a Voice to Conversational Agents in Virtual Reality Interspeech 2023 ALLURE: A Multi-Modal Guided Environment for Helping Children Learn to Solve a Rubik’s Cube with Automatic Solving and Interactive Explanations AAAI 2022 Beyond Additive Fusion: Learning Non-Additive Multimodal Interactions EMNLP 2022 A Grounded Well-being Conversational Agent with Multiple Interaction Modes: Preliminary Results ACL 2021 Analysis of Eye Gaze Reasons and Gaze Aversions During Three-Party Conversations Interspeech 2021 Boundary Proposal Network for Two-stage Natural Language Video Localization AAAI 2021 MIRTT: Learning Multimodal Interaction Representations from Trilinear Transformers for Visual Question Answering EMNLP 2021 Region under Discussion for visual dialog EMNLP 2021 MMPE: A Multi-Modal Interface using Handwriting, Touch Reordering, and Speech Commands for Post-Editing Machine Translation ACL 2020 Situated and Interactive Multimodal Conversations COLING 2020 Corpus of Multimodal Interaction for Collaborative Planning NAACL 2019 Dual Visual Attention Network for Visual Dialog IJCAI 2019 SMILEE: Symmetric Multi-modal Interactions with Language-gesture Enabled (AI) Embodiment NAACL 2018 Co-Production of Speech and Pointing Gestures in Clear and Perturbed Interactive Tasks: Multimodal Designation Strategies Interspeech 2017 The Effect of Gesture on Persuasive Speech Interspeech 2017