Multimodal Learning

OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework ICML 2022 OmniVL: One Foundation Model for Image-Language and Video-Language Tasks NeurIPS 2022 Omnivore: A Single Model for Many Visual Modalities CVPR 2022 One Agent To Rule Them All: Towards Multi-agent Conversational AI ACL 2022 One-Shot Talking Face Generation from Single-Speaker Audio-Visual Correlation Learning AAAI 2022 On Guiding Visual Attention With Language Specification CVPR 2022 Open-Domain, Content-Based, Multi-Modal Fact-Checking of Out-of-Context Images via Online Resources CVPR 2022 Open-domain Video Commentary Generation EMNLP 2022 Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labeling CVPR 2022 OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regression NeurIPS 2022 OTKGE: Multi-modal Knowledge Graph Embeddings via Optimal Transport NeurIPS 2022 OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning AAAI 2022 Panoptic, Instance and Semantic Relations: A Relational Context Encoder To Enhance Panoptic Segmentation CVPR 2022 Paraphrasing Is All You Need for Novel Object Captioning NeurIPS 2022 PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models EMNLP 2022 Phone-ing it in: Towards Flexible Multi-Modal Language Model Training by Phonetic Representations of Data ACL 2022 PluGeN: Multi-Label Conditional Generation from Pre-trained Models AAAI 2022 PoseKernelLifter: Metric Lifting of 3D Human Pose Using Sound CVPR 2022 Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues ACL 2022 Probing Cross-modal Semantics Alignment Capability from the Textual Perspective EMNLP 2022 Prompting for Multimodal Hateful Meme Classification EMNLP 2022 PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretraining NeurIPS 2022 RaP: Redundancy-aware Video-language Pre-training for Text-Video Retrieval EMNLP 2022 Reading To Listen at the Cocktail Party: Multi-Modal Speech Separation CVPR 2022 Recipe2Vec: Multi-modal Recipe Representation Learning with Graph Neural Networks IJCAI 2022