conftrace_
← Keywords

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

SciMind: A Multimodal Mixture-of-Experts Model for Advancing Pharmaceutical Sciences ACL 2024
Chain-of-Exemplar: Enhancing Distractor Generation for Multimodal Educational Question Generation ACL 2024
SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents ACL 2024
EmpathyEar: An Open-source Avatar Multimodal Empathetic Chatbot ACL 2024
Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMs ACL 2024
Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models ACL 2024
ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation ACL 2024
LANS: A Layout-Aware Neural Solver for Plane Geometry Problem ACL 2024
TempCompass: Do Video LLMs Really Understand Videos? ACL 2024
NeuroBOLT: Resting-state EEG-to-fMRI Synthesis with Multi-dimensional Feature Mapping NIPS 2024
BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays NIPS 2024
TEAM MIPAL at MEDIQA-M3G 2024: Large VQA Models for Dermatological Diagnosis NAACL 2024
CELLO: Causal Evaluation of Large Vision-Language Models EMNLP 2024
Eyes Don’t Lie: Subjective Hate Annotation and Detection with Gaze EMNLP 2024
FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Models EMNLP 2024
M3D: MultiModal MultiDocument Fine-Grained Inconsistency Detection EMNLP 2024
Computational Meme Understanding: A Survey EMNLP 2024
Investigating the Role of Instruction Variety and Task Difficulty in Robotic Manipulation Tasks EMNLP 2024
Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model EMNLP 2024
Introducing GenCeption for Multimodal LLM Benchmarking: You May Bypass Annotations NAACL 2024
Retrieval-Augmented Embodied Agents CVPR 2024
OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning CVPR 2024
SonicVisionLM: Playing Sound with Vision Language Models CVPR 2024
SignCLIP: Connecting Text and Sign Language by Contrastive Learning EMNLP 2024
Dual-oriented Disentangled Network with Counterfactual Intervention for Multimodal Intent Detection EMNLP 2024