Multimodal Learning

SMINet: State-Aware Multi-Aspect Interests Representation Network for Cold-Start Users Recommendation AAAI 2022 SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning NeurIPS 2022 Sparse2Dense: Learning to Densify 3D Features for 3D Object Detection NeurIPS 2022 Speaker recognition-assisted robust audio deepfake detection Interspeech 2022 SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing ACL 2022 SSNCSE NLP@TamilNLP-ACL2022: Transformer based approach for detection of abusive comment for Tamil language ACL 2022 Stereo Depth From Events Cameras: Concentrate and Focus on the Future CVPR 2022 Sub-Word Level Lip Reading With Visual Attention CVPR 2022 SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory AAAI 2022 Tailor Versatile Multi-Modal Learning for Multi-Label Emotion Recognition AAAI 2022 Talking Face Generation With Multilingual TTS CVPR 2022 Team IITP-AINLPML at WASSA 2022: Empathy Detection, Emotion Classification and Personality Detection ACL 2022 TeamX@DravidianLangTech-ACL2022: A Comparative Analysis for Troll-Based Meme Classification ACL 2022 Temporal Alignment Networks for Long-Term Video CVPR 2022 Tencent AI Lab - Shanghai Jiao Tong University Low-Resource Translation System for the WMT22 Translation Task EMNLP 2022 Tencent-MVSE: A Large-Scale Benchmark Dataset for Multi-Modal Video Similarity Evaluation CVPR 2022 Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrieval NeurIPS 2022 Text-to-Image Synthesis Based on Object-Guided Joint-Decoding Transformer CVPR 2022 Things not Written in Text: Exploring Spatial Commonsense from Visual Signals ACL 2022 Think Beyond Words: Exploring Context-Relevant Visual Commonsense for Diverse Dialogue Generation EMNLP 2022 Time-Conditioned Dances with Simplicial Complexes: Zigzag Filtration Curve based Supra-Hodge Convolution Networks for Time-series Forecasting NeurIPS 2022 T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translation EMNLP 2022 Toolbox for Multimodal Learn (scikit-multimodallearn) JMLR 2022 Touch and Go: Learning from Human-Collected Vision and Touch NeurIPS 2022 Towards Effective Multi-Modal Interchanges in Zero-Resource Sounding Object Localization NeurIPS 2022