conftrace_

multi-modal learning

1278 papers

Explore in graph

Also known as

MML

Co-occurring keywords

multimodal learning (4645) contrastive learning (4032) representation learning (6206) large language model (13587) video understanding (1658) visual question answering (1017) vision-language model (2348) attention mechanism (4001) transfer learning (5449) semantic segmentation (3186)

Papers

MESED: A Multi-Modal Entity Set Expansion Dataset with Fine-Grained Semantic Classes and Hard Negative Entities AAAI 2024
HENASY: Learning to Assemble Scene-Entities for Interpretable Egocentric Video-Language Model NIPS 2024
Generative Multi-Modal Knowledge Retrieval with Large Language Models AAAI 2024
Improving Audio-Visual Segmentation with Bidirectional Generation AAAI 2024
AFBench: A Large-scale Benchmark for Airfoil Design NIPS 2024
Customized Multiple Clustering via Multi-Modal Subspace Proxy Learning NIPS 2024
DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs NIPS 2024
GTA: A Benchmark for General Tool Agents NIPS 2024
ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualization NIPS 2024
Rethinking Reverse Distillation for Multi-Modal Anomaly Detection AAAI 2024
Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Model NIPS 2024
Efficient Large Multi-modal Models via Visual Context Compression NIPS 2024
Cross-modal Representation Flattening for Multi-modal Domain Generalization NIPS 2024
Everyday Object Meets Vision-and-Language Navigation Agent via Backdoor NIPS 2024
Learning 1D Causal Visual Representation with De-focus Attention Networks NIPS 2024
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought NIPS 2024
MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs NIPS 2024
Boosting Textural NER with Synthetic Image and Instructive Alignment ACL 2024
PPTSER: A Plug-and-Play Tag-guided Method for Few-shot Semantic Entity Recognition on Visually-rich Documents ACL 2024
II-MMR: Identifying and Improving Multi-modal Multi-hop Reasoning in Visual Question Answering ACL 2024
Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning NIPS 2024
Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model INTERSPEECH 2024
InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD NIPS 2024
Temporal Sentence Grounding with Relevance Feedback in Videos NIPS 2024
Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning NIPS 2024