Multimodal Learning

DocFin: Multimodal Financial Prediction and Bias Mitigation using Semi-structured Documents EMNLP 2022 Do Decoding Algorithms Capture Discourse Structure in Multi-Modal Tasks? A Case Study of Image Paragraph Generation EMNLP 2022 Domain Generalization Through Audio-Visual Relative Norm Alignment in First Person Action Recognition WACV 2022 Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies? EMNLP 2022 DRAG: Dynamic Region-Aware GCN for Privacy-Leaking Image Detection AAAI 2022 Dual-Channel Evidence Fusion for Fact Verification over Texts and Tables NAACL 2022 Dual-Generator Face Reenactment CVPR 2022 DUCS at SemEval-2022 Task 6: Exploring Emojis and Sentiments for Sarcasm Detection SemEval 2022 DuReadervis: A Chinese Dataset for Open-domain Document Visual Question Answering ACL 2022 DU-VLG: Unifying Vision-and-Language Generation via Dual Sequence-to-Sequence Pre-training ACL 2022 D-vlog: Multimodal Vlog Dataset for Depression Detection AAAI 2022 Dynamic 3D Gaze From Afar: Deep Gaze Estimation From Temporal Eye-Head-Body Coordination CVPR 2022 Dynamic Key-Value Memory Enhanced Multi-Step Graph Reasoning for Knowledge-Based Visual Question Answering AAAI 2022 Dynamic MLP for Fine-Grained Image Classification by Leveraging Geographical and Temporal Information CVPR 2022 E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognition CVPR 2022 Effective combination of pretrained models - KIT@IWSLT2022 ACL 2022 Egocentric Video-Language Pretraining NeurIPS 2022 EI-CLIP: Entity-Aware Interventional Contrastive Learning for E-Commerce Cross-Modal Retrieval CVPR 2022 Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level Metric EMNLP 2022 End-to-End Generative Pretraining for Multimodal Video Captioning CVPR 2022 End-to-End Modeling via Information Tree for One-Shot Natural Language Spatial Video Grounding ACL 2022 End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Maps CVPR 2022 Entity-centered Cross-document Relation Extraction EMNLP 2022 Entity-level Interaction via Heterogeneous Graph for Multimodal Named Entity Recognition EMNLP 2022 EnvEdit: Environment Editing for Vision-and-Language Navigation CVPR 2022