Multimodal Learning

Semantic Token Reweighting for Interpretable and Controllable Text Embeddings in CLIP EMNLP 2024 SEMANTIFY: Unveiling Memes with Robust Interpretability beyond Input Attribution IJCAI 2024 SemEval 2024 - Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF) SemEval 2024 SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversations SemEval 2024 SemEval-2024 Task 4: Multilingual Detection of Persuasion Techniques in Memes SemEval 2024 Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning NAACL 2024 SemTra: A Semantic Skill Translator for Cross-Domain Zero-Shot Policy Adaptation AAAI 2024 SENSE-LM : A Synergy between a Language Model and Sensorimotor Representations for Auditory and Olfactory Information Extraction EACL 2024 Separate and Reconstruct: Asymmetric Encoder-Decoder for Speech Separation NeurIPS 2024 Separate in the Speech Chain: Cross-Modal Conditional Audio-Visual Target Speech Extraction IJCAI 2024 Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language CVPR 2024 Sequence Shortening for Context-Aware Machine Translation EACL 2024 Sequential Compositional Generalization in Multimodal Models NAACL 2024 SERPENT-VLM : Self-Refining Radiology Report Generation Using Vision Language Models NAACL 2024 Set-Aligning Framework for Auto-Regressive Event Temporal Graph Generation NAACL 2024 SeTformer Is What You Need for Vision and Language AAAI 2024 Shadowcast: Stealthy Data Poisoning Attacks Against Vision-Language Models NeurIPS 2024 Shadow Generation with Decomposed Mask Prediction and Attentive Shadow Filling AAAI 2024 Shaking Up VLMs: Comparing Transformers and Structured State Space Models for Vision & Language Modeling EMNLP 2024 Shape From Shading for Robotic Manipulation WACV 2024 ShapeLLM: Universal 3D Object Understanding for Embodied Interaction ECCV 2024 ShapeWalk: Compositional Shape Editing Through Language-Guided Chains CVPR 2024 SheffieldVeraAI at SemEval-2024 Task 4: Prompting and fine-tuning a Large Vision-Language Model for Binary Classification of Persuasion Techniques in Memes SemEval 2024 Show and Guide: Instructional-Plan Grounded Vision and Language Model EMNLP 2024 Show Your Face: Restoring Complete Facial Images From Partial Observations for VR Meeting WACV 2024