conftrace_
← Keywords

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

SECap: Speech Emotion Captioning with Large Language Model AAAI 2024
Polos: Multimodal Metric Learning from Human Feedback for Image Captioning CVPR 2024
Video-Context Aligned Transformer for Video Question Answering AAAI 2024
Multilingual Diversity Improves Vision-Language Representations NIPS 2024
Flexible Biometrics Recognition: Bridging the Multimodality Gap through Attention Alignment and Prompt Tuning CVPR 2024
Mitigating Object Hallucination via Concentric Causal Attention NIPS 2024
VideoGUI: A Benchmark for GUI Automation from Instructional Videos NIPS 2024
What When and Where? Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions CVPR 2024
Hidden in Plain Sight: Evaluating Abstract Shape Recognition in Vision-Language Models NIPS 2024
Unsupervised Modality Adaptation with Text-to-Image Diffusion Models for Semantic Segmentation NIPS 2024
UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling NIPS 2024
SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLM NIPS 2024
DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ NIPS 2024
GTA: A Benchmark for General Tool Agents NIPS 2024
ParaCLAP – Towards a general language-audio model for computational paralinguistic tasks INTERSPEECH 2024
Decomposing and Interpreting Image Representations via Text in ViTs Beyond CLIP NIPS 2024
SpeechForensics: Audio-Visual Speech Representation Learning for Face Forgery Detection NIPS 2024
Enhancing Motion in Text-to-Video Generation with Decomposed Encoding and Conditioning NIPS 2024
G2PA: G2P with Aligned Audio for Mandarin Chinese INTERSPEECH 2024
OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding NIPS 2024
Unity in Diversity: Collaborative Pre-training Across Multimodal Medical Sources ACL 2024
Multi-Object Hallucination in Vision Language Models NIPS 2024
OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents NIPS 2024
WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NIPS 2024
Slot-VLM: Object-Event Slots for Video-Language Modeling NIPS 2024