Multimodal Learning

LLM-Driven Multimodal Opinion Expression Identification Interspeech 2024 LLM-grounded Video Diffusion Models ICLR 2024 LLM Knows Body Language, Too: Translating Speech Voices into Human Gestures ACL 2024 LLMs are Good Action Recognizers CVPR 2024 LLMs are Good Sign Language Translators CVPR 2024 LLMs Can Evolve Continually on Modality for X-Modal Reasoning NeurIPS 2024 LLMs Meet VLMs: Boost Open Vocabulary Object Detection with Fine-grained Descriptors ICLR 2024 L+M-24: Building a Dataset for Language+Molecules @ ACL 2024 ACL 2024 LMDrive: Closed-Loop End-to-End Driving with Large Language Models CVPR 2024 LMDX: Language Model-based Document Information Extraction and Localization ACL 2024 LMEME at SemEval-2024 Task 4: Teacher Student Fusion - Integrating CLIP with LLMs for Enhanced Persuasion Detection SemEval 2024 Localization vs. Semantics: Visual Representations in Unimodal and Multimodal Models EACL 2024 LoCoNet: Long-Short Context Network for Active Speaker Detection CVPR 2024 LOCR: Location-Guided Transformer for Optical Character Recognition EMNLP 2024 Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitives CVPR 2024 LoD-Loc: Aerial Visual Localization using LoD 3D Map with Neural Wireframe Alignment NeurIPS 2024 LomonosovMSU at SemEval-2024 Task 4: Comparing LLMs and embedder models to identifying propaganda techniques in the content of memes in English for subtasks No1, No2a, and No2b SemEval 2024 Longform Multimodal Lay Summarization of Scientific Papers: Towards Automatically Generating Science Blogs from Research Articles COLING 2024 Long-Form Recordings to Study Children’s Language Input and Output in Under-Resourced Contexts COLING 2024 Look before You Leap: Dual Logical Verification for Knowledge-based Visual Question Generation COLING 2024 Looking Similar Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learning CVPR 2024 Look, Listen, and Answer: Overcoming Biases for Audio-Visual Question Answering NeurIPS 2024 LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference EMNLP 2024 Look, Remember and Reason: Grounded Reasoning in Videos with Language Models ICLR 2024 Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts EMNLP 2024