conftrace_
← Resources & Methods
Natural Language Processing › Resources & Methods ›

Multimodal NLP

97 papers

Papers per year

2
1
2
3
8
10
15
8
11
30
7

Papers

Spontaneous gestures encoded by hand positions improve language models: An Information-Theoretic motivated study ACL 2023
Dynamic Inference With Grounding Based Vision and Language Models CVPR 2023
Position-Guided Text Prompt for Vision-Language Pre-Training CVPR 2023
Clover: Towards a Unified Video-Language Alignment and Fusion Model CVPR 2023
M2C: Towards Automatic Multimodal Manga Complement EMNLP 2023
Grounded and well-rounded: a methodological approach to the study of cross-modal and cross-lingual grounding EMNLP 2023
TaiSu: A 166M Large-scale High-Quality Dataset for Chinese Vision-Language Pre-training NIPS 2022
Bridging between Cognitive Processing Signals and Linguistic Features via a Unified Attentional Network AAAI 2022
UniTranSeR: A Unified Transformer Semantic Representation Framework for Multimodal Task-Oriented Dialog System ACL 2022
CogBERT: Cognition-Guided Pre-trained Language Models COLING 2022
XYLayoutLM: Towards Layout-Aware Multimodal Networks for Visually-Rich Document Understanding CVPR 2022
Unsupervised Vision-and-Language Pre-Training via Retrieval-Based Multi-Granular Alignment CVPR 2022
ADAPT: Vision-Language Navigation With Modality-Aligned Action Prompts CVPR 2022
LAVT: Language-Aware Vision Transformer for Referring Image Segmentation CVPR 2022
Revisiting the "Video" in Video-Language Understanding CVPR 2022
Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality EMNLP 2022
RaP: Redundancy-aware Video-language Pre-training for Text-Video Retrieval EMNLP 2022
Focus! Relevant and Sufficient Context Selection for News Image Captioning EMNLP 2022
Visual Grounding of Inter-lingual Word-Embeddings EMNLP 2022
Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts ICML 2022
Separate What You Describe: Language-Queried Audio Source Separation INTERSPEECH 2022
Audio-Oriented Multimodal Machine Comprehension via Dynamic Inter- and Intra-modality Attention AAAI 2021
LAMS: A Location-aware Approach for Multimodal Summarization (Student Abstract) AAAI 2021
M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-Training CVPR 2021
The World of an Octopus: How Reporting Bias Influences a Language Model’s Perception of Color EMNLP 2021