← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

Detecting Frames in News Headlines and Lead Images in U.S. Gun Violence Coverage EMNLP 2021
Grounding Plural Phrases: Countering Evaluation Biases by Individuation NAACL 2021
Video-guided Machine Translation with Spatial Hierarchical Attention Network ACL 2021
Transitional Adaptation of Pretrained Models for Visual Storytelling CVPR 2021
Look Wide and Interpret Twice: Improving Performance on Interactive Instruction-following Tasks IJCAI 2021
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-Modal Pre-Training AAAI 2020
Retouchdown: Releasing Touchdown on StreetLearn as a Public Resource for Language Grounding Tasks in Street View EMNLP 2020
Utilizing Multimodal Feature Consistency to Detect Adversarial Examples on Clinical Summaries EMNLP 2020
Open-Ended Visual Question Answering by Multi-Modal Domain Adaptation EMNLP 2020
Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contexts EMNLP 2020
Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervision EMNLP 2020
Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements EMNLP 2020
Unsupervised Natural Language Inference via Decoupled Multimodal Contrastive Learning EMNLP 2020
Video2Commonsense: Generating Commonsense Descriptions to Enrich Video Captioning EMNLP 2020
Multimodal Joint Attribute Prediction and Value Extraction for E-commerce Product EMNLP 2020
The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes NIPS 2020
Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube EMNLP 2020
Fine-Grained Grounding for Multimodal Speech Recognition EMNLP 2020
Multimodal Speech Recognition with Unstructured Audio Masking EMNLP 2020
Multimodal Generative Learning Utilizing Jensen-Shannon-Divergence NIPS 2020
COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning NIPS 2020
What is More Likely to Happen Next? Video-and-Language Future Event Prediction EMNLP 2020
Decoding Language Spatial Relations to 2D Spatial Arrangements EMNLP 2020
BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues EMNLP 2020
Visually Grounded Continual Learning of Compositional Phrases EMNLP 2020