Multimodal Learning

Word Discovery in Visually Grounded, Self-Supervised Speech Models Interspeech 2022 Word-Level Fine-Grained Story Visualization ECCV 2022 Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models NAACL 2022 xGQA: Cross-Lingual Visual Question Answering ACL 2022 XMP-Font: Self-Supervised Cross-Modality Pre-Training for Few-Shot Font Generation CVPR 2022 X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval CVPR 2022 X-Trans2Cap: Cross-Modal Knowledge Transfer Using Transformer for 3D Dense Captioning CVPR 2022 YMAI at SemEval-2022 Task 5: Detecting Misogyny in Memes using VisualBERT and MMBT MultiModal Pre-trained Models SemEval 2022 YNU-HPCC at SemEval-2022 Task 5: Multi-Modal and Multi-label Emotion Classification Based on LXMERT SemEval 2022 YNU-HPCC at SemEval-2022 Task 6: Transformer-based Model for Intended Sarcasm Detection in English and Arabic SemEval 2022 YNU-HPCC at SemEval-2022 Task 8: Transformer-based Ensemble Model for Multilingual News Article Similarity SemEval 2022 You Only Infer Once: Cross-Modal Meta-Transfer for Referring Video Object Segmentation AAAI 2022 You Truly Understand What I Need : Intellectual and Friendly Dialog Agents grounding Persona and Knowledge EMNLP 2022 Zero-Shot Text-Guided Object Generation With Dream Fields CVPR 2022 Zero-Shot Voice Conditioning for Denoising Diffusion TTS Models Interspeech 2022 Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imagination EMNLP 2022 1213Li at SemEval-2021 Task 6: Detection of Propaganda with Multi-modal Attention and Pre-trained Models SemEval 2021 2D to 3D Medical Image Colorization WACV 2021 3D-MAN: 3D Multi-Frame Attention Network for Object Detection CVPR 2021 A 3D Generative Model for Structure-Based Drug Design NeurIPS 2021 Abusive Language Detection in Heterogeneous Contexts: Dataset Collection and the Role of Supervised Attention AAAI 2021 A Computational Approach to Sign Language Understanding AAAI 2021 Acoustic Echo Cancellation with Cross-Domain Learning Interspeech 2021 Acoustic Event Detection with Classifier Chains Interspeech 2021 A Cross-Dialectal Comparison of Apical Vowels in Beijing Mandarin, Northeastern Mandarin and Southwestern Mandarin: An EMA and Ultrasound Study Interspeech 2021