Multimodal Learning

Hierarchical Multi-Supervision Multi-Interaction Graph Attention Network for Multi-Camera Pedestrian Trajectory Prediction AAAI 2022 I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classification NeurIPS 2022 Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning WACV 2022 Knowledge-Enhanced Scene Graph Generation with Multimodal Relation Alignment (Student Abstract) AAAI 2022 Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners NeurIPS 2022 LaTr: Layout-Aware Transformer for Scene-Text VQA CVPR 2022 LAVT: Language-Aware Vision Transformer for Referring Image Segmentation CVPR 2022 Learnable Irrelevant Modality Dropout for Multimodal Action Recognition on Modality-Specific Annotated Videos CVPR 2022 Learning Action-Effect Dynamics for Hypothetical Vision-Language Reasoning Task EMNLP 2022 Learning Affordance Grounding From Exocentric Images CVPR 2022 Learning Audio-Visual Dynamics Using Scene Graphs for Audio Source Separation NeurIPS 2022 Learning Functional Distributional Semantics with Visual Data ACL 2022 Learning Program Representations for Food Images and Cooking Recipes CVPR 2022 Lexi: Self-Supervised Learning of the UI Language EMNLP 2022 LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation EMNLP 2022 MACK: Multimodal Aligned Conceptual Knowledge for Unpaired Image-text Matching NeurIPS 2022 Maintaining Reasoning Consistency in Compositional Visual Question Answering CVPR 2022 Make It Move: Controllable Image-to-Video Generation With Text Descriptions CVPR 2022 ManiTrans: Entity-Level Text-Guided Image Manipulation via Token-Wise Semantic Alignment and Generation CVPR 2022 MERLOT Reserve: Neural Script Knowledge Through Vision and Language and Sound CVPR 2022 MMCoQA: Conversational Question Answering over Text, Tables, and Images ACL 2022 MM-GATBT: Enriching Multimodal Representation Using Graph Attention Network NAACL 2022 MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-Based Visual Question Answering CVPR 2022 Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts ICML 2022 Multilingual and Multimodal Topic Modelling with Pretrained Embeddings COLING 2022