Multimodal Learning

Text-To-Concept (and Back) via Cross-Model Alignment ICML 2023 Textually Pretrained Speech Language Models NeurIPS 2023 Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignment IJCAI 2023 Text With Knowledge Graph Augmented Transformer for Video Captioning CVPR 2023 TG-VQA: Ternary Game of Video Question Answering IJCAI 2023 The ART of Conversation: Measuring Phonetic Convergence and Deliberate Imitation in L2-Speech with a Siamese RNN Interspeech 2023 The BLA Benchmark: Investigating Basic Language Abilities of Pre-Trained Multimodal Models EMNLP 2023 The CropAndWeed Dataset: A Multi-Modal Learning Approach for Efficient Crop and Weed Manipulation WACV 2023 The Hidden Dance of Phonemes and Visage: Unveiling the Enigmatic Link between Phonemes and Facial Features Interspeech 2023 The HW-TSC’s Simultaneous Speech-to-Text Translation System for IWSLT 2023 Evaluation ACL 2023 The HW-TSC’s Speech-to-Speech Translation System for IWSLT 2023 ACL 2023 The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translation EMNLP 2023 The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation ICLR 2023 The NiuTrans End-to-End Speech Translation System for IWSLT23 English-to-Chinese Offline Task ACL 2023 The ToMCAT Dataset NeurIPS 2023 The Unreasonable Effectiveness of Large Language-Vision Models for Source-Free Video Domain Adaptation ICCV 2023 Three Stream Based Multi-level Event Contrastive Learning for Text-Video Event Extraction EMNLP 2023 TI2Net: Temporal Identity Inconsistency Network for Deepfake Detection WACV 2023 TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering ICCV 2023 TILFA: A Unified Framework for Text, Image, and Layout Fusion in Argument Mining EMNLP 2023 Time Series of Satellite Imagery Improve Deep Learning Estimates of Neighborhood-Level Poverty in Africa IJCAI 2023 TOA: Task-oriented Active VQA NeurIPS 2023 Token Mixing: Parameter-Efficient Transfer Learning from Image-Language to Video-Language AAAI 2023 Too Large; Data Reduction for Vision-Language Pre-Training ICCV 2023 ToonTalker: Cross-Domain Face Reenactment ICCV 2023