Multimodal Learning

KAT: A Knowledge Augmented Transformer for Vision-and-Language NAACL 2022 Kernel Multimodal Continuous Attention NeurIPS 2022 Knowledge-Enhanced Scene Graph Generation with Multimodal Relation Alignment (Student Abstract) AAAI 2022 Knowledge-grounded Dialog State Tracking EMNLP 2022 Knowledge Transfer with Visual Prompt in multi-modal Dialogue Understanding and Generation COLING 2022 LAION-5B: An open large-scale dataset for training next generation image-text models NeurIPS 2022 Language-agnostic Semantic Consistent Text-to-Image Generation ACL 2022 Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentation CVPR 2022 Language Conditioned Spatial Relation Reasoning for 3D Object Grounding NeurIPS 2022 Language Model Augmented Monotonic Attention for Simultaneous Translation NAACL 2022 Language Models of Code are Few-Shot Commonsense Learners EMNLP 2022 Language over Labels: Contrastive Language Supervision Exceeds Purely Label-Supervised Classification Performance on Chest X-Rays AACL 2022 LastResort at SemEval-2022 Task 5: Towards Misogyny Identification using Visual Linguistic Model Ensembles And Task-Specific Pretraining SemEval 2022 LAVT: Language-Aware Vision Transformer for Referring Image Segmentation CVPR 2022 L-CoDe:Language-Based Colorization Using Color-Object Decoupled Conditions AAAI 2022 LD-ConGR: A Large RGB-D Video Dataset for Long-Distance Continuous Gesture Recognition CVPR 2022 Leaky Gated Cross-Attention for Weakly Supervised Multi-Modal Temporal Action Localization WACV 2022 Learnable Irrelevant Modality Dropout for Multimodal Action Recognition on Modality-Specific Annotated Videos CVPR 2022 Learnable Multi-Level Frequency Decomposition and Hierarchical Attention Mechanism for Generalized Face Presentation Attack Detection WACV 2022 Learning Action-Effect Dynamics for Hypothetical Vision-Language Reasoning Task EMNLP 2022 Learning Affordance Grounding From Exocentric Images CVPR 2022 Learning Audio-Text Agreement for Open-vocabulary Keyword Spotting Interspeech 2022 Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction ICLR 2022 Learning Based Multi-Modality Image and Video Compression CVPR 2022 Learning from Adjective-Noun Pairs: A Knowledge-enhanced Framework for Target-Oriented Multimodal Sentiment Classification COLING 2022