conftrace_
← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

Generative Multi-modal Models are Good Class Incremental Learners CVPR 2024
A Vision Check-up for Language Models CVPR 2024
Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations CVPR 2024
The STVchrono Dataset: Towards Continuous Change Recognition in Time CVPR 2024
Language Model Guided Interpretable Video Action Reasoning CVPR 2024
MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts EMNLP 2024
“Image, Tell me your story!” Predicting the original meta-context of visual misinformation EMNLP 2024
Towards Intelligent Speech Assistants in Operating Rooms: A Multimodal Model for Surgical Workflow Analysis INTERSPEECH 2024
PICTURE: PhotorealistIC virtual Try-on from UnconstRained dEsigns CVPR 2024
RegionGPT: Towards Region Understanding Vision Language Model CVPR 2024
Generating Illustrated Instructions CVPR 2024
Vlogger: Make Your Dream A Vlog CVPR 2024
GROUNDHOG: Grounding Large Language Models to Holistic Segmentation CVPR 2024
Rich Human Feedback for Text-to-Image Generation CVPR 2024
Selectively Informative Description can Reduce Undesired Embedding Entanglements in Text-to-Image Personalization CVPR 2024
Natural Language-based State Representation in Deep Reinforcement Learning NAACL 2024
Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding INTERSPEECH 2024
An End-to-End Speech Summarization Using Large Language Model INTERSPEECH 2024
MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting INTERSPEECH 2024
Spontaneous Speech-Based Suicide Risk Detection Using Whisper and Large Language Models INTERSPEECH 2024
LLM-Driven Multimodal Opinion Expression Identification INTERSPEECH 2024
Instruction Data Generation and Unsupervised Adaptation for Speech Language Models INTERSPEECH 2024
Participant-Pair-Wise Bottleneck Transformer for Engagement Estimation from Video Conversation INTERSPEECH 2024
Understanding Sounds, Missing the Questions: The Challenge of Object Hallucination in Large Audio-Language Models INTERSPEECH 2024
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment INTERSPEECH 2024