multimodal reasoning

FIBER: Fill-in-the-Blanks as a Challenging Video Understanding Evaluation Framework ACL 2022 HOLM: Hallucinating Objects with Language Models for Referring Expression Recognition in Partially-Observed Scenes ACL 2022 Information-Theoretic Text Hallucination Reduction for Video-grounded Dialogue EMNLP 2022 Modal-specific Pseudo Query Generation for Video Corpus Moment Retrieval EMNLP 2022 OpenCQA: Open-ended Question Answering with Charts EMNLP 2022 Perceiver IO: A General Architecture for Structured Inputs & Outputs ICLR 2022 Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues ACL 2022 Rethinking the Video Sampling and Reasoning Strategies for Temporal Sentence Grounding EMNLP 2022 Shifting More Attention to Visual Backbone: Query-Modulated Refinement Networks for End-to-End Visual Grounding CVPR 2022 UniGeo: Unifying Geometry Logical Reasoning via Reformulating Mathematical Expression EMNLP 2022 WebQA: Multihop and Multimodal QA CVPR 2022 Explainable Video Entailment With Grounded Visual Evidence ICCV 2021 Improving Image Captioning by Leveraging Intra- and Inter-layer Global Representation in Transformer Network AAAI 2021 Improving Pre-trained Vision-and-Language Embeddings for Phrase Grounding EMNLP 2021 In Factuality: Efficient Integration of Relevant Facts for Visual Question Answering ACL 2021 Learning from Inside: Self-driven Siamese Sampling and Reasoning for Video Question Answering NeurIPS 2021 MERLOT: Multimodal Neural Script Knowledge Models NeurIPS 2021 MultiModalQA: complex question answering over text, tables and images ICLR 2021 Multi-Modal Reasoning Graph for Scene-Text Based Fine-Grained Image Classification and Retrieval WACV 2021 Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision ICCV 2021 UniT: Multimodal Multitask Learning With a Unified Transformer ICCV 2021 Visual Goal-Step Inference using wikiHow EMNLP 2021 Cross-Modality Relevance for Reasoning on Language and Vision ACL 2020 KnowIT VQA: Answering Knowledge-Based Questions about Videos AAAI 2020 Violin: A Large-Scale Dataset for Video-and-Language Inference CVPR 2020