Multimodal Learning

Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts NeurIPS 2022 Multimodal Dialogue State Tracking NAACL 2022 Multimodal Sarcasm Target Identification in Tweets ACL 2022 Multimodal Semi-supervised Learning for Disaster Tweet Classification COLING 2022 Multimodal Token Fusion for Vision Transformers CVPR 2022 MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding AAAI 2022 Neural Collaborative Graph Machines for Table Structure Recognition CVPR 2022 NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks CVPR 2022 OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusion CVPR 2022 One-Shot Talking Face Generation from Single-Speaker Audio-Visual Correlation Learning AAAI 2022 Open-Domain, Content-Based, Multi-Modal Fact-Checking of Out-of-Context Images via Online Resources CVPR 2022 Open-Domain Sign Language Translation Learned from Online Video EMNLP 2022 PointCLIP: Point Cloud Understanding by CLIP CVPR 2022 Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues ACL 2022 Probing Cross-modal Semantics Alignment Capability from the Textual Perspective EMNLP 2022 RaP: Redundancy-aware Video-language Pre-training for Text-Video Retrieval EMNLP 2022 Region-Aware Face Swapping CVPR 2022 REX: Reasoning-Aware and Grounded Explanation CVPR 2022 Ring That Bell: A Corpus and Method for Multimodal Metaphor Detection in Videos EMNLP 2022 SAC: Semantic Attention Composition for Text-Conditioned Image Retrieval WACV 2022 SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections NeurIPS 2022 ScanQA: 3D Question Answering for Spatial Scene Understanding CVPR 2022 Scene-Text Aware Image and Text Retrieval with Dual-Encoder ACL 2022 SEEG: Semantic Energized Co-Speech Gesture Generation CVPR 2022 SGEITL: Scene Graph Enhanced Image-Text Learning for Visual Commonsense Reasoning AAAI 2022