Multimodal Learning

VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks CVPR 2022 VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers CVPR 2022 VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts NeurIPS 2022 VLStereoSet: A Study of Stereotypical Bias in Pre-trained Vision-Language Models AACL 2022 Vocal-Tract Area Functions with Articulatory Reality for Tract Opening Interspeech 2022 VoiceFixer: A Unified Framework for High-Fidelity Speech Restoration Interspeech 2022 Voxel-informed Language Grounding ACL 2022 VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids NeurIPS 2022 Weakly Supervised Branch Network With Template Mask for Classifying Masses in 3D Automated Breast Ultrasound WACV 2022 Weakly-Supervised Generation and Grounding of Visual Descriptions With Conditional Generative Models CVPR 2022 Weakly-Supervised Temporal Article Grounding EMNLP 2022 WebQA: Multihop and Multimodal QA CVPR 2022 WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents NeurIPS 2022 What do Models Learn From Training on More Than Text? Measuring Visual Commonsense Knowledge ACL 2022 What’s Different between Visual Question Answering for Machine “Understanding” Versus for Accessibility? AACL 2022 When Can Transformers Ground and Compose: Insights from Compositional Generalization Benchmarks EMNLP 2022 When did you become so smart, oh wise one?! Sarcasm Explanation in Multi-modal Multi-party Dialogues ACL 2022 When does CLIP generalize better than unimodal models? When judging human-centric concepts ACL 2022 When to Laugh and How Hard? A Multimodal Approach to Detecting Humor and Its Intensity COLING 2022 Whose Hands Are These? Hand Detection and Hand-Body Association in the Wild CVPR 2022 Why do We Need Large Batchsizes in Contrastive Learning? A Gradient-Bias Perspective NeurIPS 2022 Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality EMNLP 2022 WikiDiverse: A Multimodal Entity Linking Dataset with Diversified Contextual Topics and Entity Types ACL 2022 WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models NeurIPS 2022 Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality CVPR 2022