Multimodal Learning

SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLM NeurIPS 2024 SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models CVPR 2024 SmartTrim: Adaptive Tokens and Attention Pruning for Efficient Vision-Language Models COLING 2024 SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models NAACL 2024 SMM4H’24 Task6 : Extracting Self-Reported Age with LLM and BERTweet: Fine-Grained Approaches for Social Media Text ACL 2024 Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attention NeurIPS 2024 SnapNTell: Enhancing Entity-Centric Visual Question Answering with Retrieval Augmented Multimodal LLM EMNLP 2024 Snarci at SemEval-2024 Task 4: Themis Model for Binary Classification of Memes SemEval 2024 SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detection CVPR 2024 SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examples CVPR 2024 SocialGPT: Prompting LLMs for Social Relation Reasoning via Greedy Segment Optimization NeurIPS 2024 Social Meme-ing: Measuring Linguistic Variation in Memes NAACL 2024 SoftCLIP: Softer Cross-Modal Alignment Makes CLIP Stronger AAAI 2024 Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning COLING 2024 SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge CVPR 2024 Solar Power Generation Forecasting via Multimodal Feature Fusion (Student Abstract) AAAI 2024 Solving General Noisy Inverse Problem via Posterior Sampling: A Policy Gradient Viewpoint AISTATS 2024 SoMeLVLM: A Large Vision Language Model for Social Media Processing ACL 2024 SongCreator: Lyrics-based Universal Song Generation NeurIPS 2024 SonicVisionLM: Playing Sound with Vision Language Models CVPR 2024 Soul-Mix: Enhancing Multimodal Machine Translation with Manifold Mixup ACL 2024 SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos CVPR 2024 SpaceGTN: A Time-Agnostic Graph Transformer Network for Handwritten Diagram Recognition and Segmentation AAAI 2024 SPAD: Spatially Aware Multi-View Diffusers CVPR 2024 SPARK: Harnessing Human-Centered Workflows with Biomedical Foundation Models for Drug Discovery IJCAI 2024