multimodal transformer

Attention as Grounding: Exploring Textual and Cross-Modal Attention on Entities and Relations in Language-and-Vision Transformer ACL 2022 Circulant-interactive Transformer with Dimension-aware Fusion for Multimodal Sentiment Analysis ACML 2022 COFAR: Commonsense and Factual Reasoning in Image Search AACL 2022 Do Decoding Algorithms Capture Discourse Structure in Multi-Modal Tasks? A Case Study of Image Paragraph Generation EMNLP 2022 End-to-End Referring Video Object Segmentation With Multimodal Transformers CVPR 2022 ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding EMNLP 2022 IIITH at SemEval-2022 Task 5: A comparative study of deep learning models for identifying misogynous memes SemEval 2022 KAT: A Knowledge Augmented Transformer for Vision-and-Language NAACL 2022 Learning Temporal Video Procedure Segmentation From an Automatically Collected Large Dataset WACV 2022 M3L: Language-Based Video Editing via Multi-Modal Multi-Level Transformers CVPR 2022 M5Product: Self-Harmonized Contrastive Learning for E-Commercial Multi-Modal Pretraining CVPR 2022 MMT: Multi-way Multi-modal Transformer for Multimodal Learning IJCAI 2022 SGEITL: Scene Graph Enhanced Image-Text Learning for Visual Commonsense Reasoning AAAI 2022 SMARTAVE: Structured Multimodal Transformer for Product Attribute Value Extraction EMNLP 2022 UMT: Unified Multi-Modal Transformers for Joint Video Moment Retrieval and Highlight Detection CVPR 2022 Visio-Linguistic Brain Encoding COLING 2022 VISITRON: Visual Semantics-Aligned Interactively Trained Object-Navigator ACL 2022 VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers CVPR 2022 XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding ACL 2022 A Web Scale Entity Extraction System EMNLP 2021 CLIP-It! Language-Guided Video Summarization NeurIPS 2021 Confidence-aware Non-repetitive Multimodal Transformers for TextCaps AAAI 2021 DocFormer: End-to-End Transformer for Document Understanding ICCV 2021 Grounding Spatio-Temporal Language with Transformers NeurIPS 2021 History Aware Multimodal Transformer for Vision-and-Language Navigation NeurIPS 2021