Multimodal NLP

Unveiling the Mist over 3D Vision-Language Understanding: Object-centric Evaluation with Chain-of-Analysis CVPR 2025 UoR-NCL at SemEval-2025 Task 1: Using Generative LLMs and CLIP Models for Multilingual Multimodal Idiomaticity Representation SemEval 2025 Using and comprehending language in face-to-face conversation Interspeech 2025 Vision-Language Models Can't See the Obvious ICCV 2025 VLG-BERT: Towards Better Interpretability in LLMs through Visual and Linguistic Grounding NAACL 2025 VLog: Video-Language Models by Generative Retrieval of Narration Vocabulary CVPR 2025 CLIP-DIY: CLIP Dense Inference Yields Open-Vocabulary Semantic Segmentation For-Free WACV 2024 DocLLM: A Layout-Aware Generative Language Model for Multimodal Document Understanding ACL 2024 Exploring the Potential of Multimodal LLM with Knowledge-Intensive Multimodal ASR EMNLP 2024 Image-Text Co-Decomposition for Text-Supervised Semantic Segmentation CVPR 2024 Improving Vision-and-Language Reasoning via Spatial Relations Modeling WACV 2024 Linguistic-Aware Patch Slimming Framework for Fine-grained Cross-Modal Alignment CVPR 2024 MM-SOC: Benchmarking Multimodal Large Language Models in Social Media Platforms ACL 2024 Multilingual Synopses of Movie Narratives: A Dataset for Vision-Language Story Understanding EMNLP 2024 Nebula: A discourse aware Minecraft Builder EMNLP 2024 Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarks ACL 2024 Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Models CVPR 2024 CIF-PT: Bridging Speech and Text Representations for Spoken Language Understanding via Continuous Integrate-and-Fire Pre-Training ACL 2023 Clover: Towards a Unified Video-Language Alignment and Fusion Model CVPR 2023 Coupling Artificial Neurons in BERT and Biological Neurons in the Human Brain AAAI 2023 Dynamic Inference With Grounding Based Vision and Language Models CVPR 2023 Grounded and well-rounded: a methodological approach to the study of cross-modal and cross-lingual grounding EMNLP 2023 M2C: Towards Automatic Multimodal Manga Complement EMNLP 2023 Position-Guided Text Prompt for Vision-Language Pre-Training CVPR 2023 Spontaneous gestures encoded by hand positions improve language models: An Information-Theoretic motivated study ACL 2023