ARTKGC: Leakage-Controlled Multimodal Knowledge Graph Completion for Artwork Explanation
Abstract
AbstractExplaining an artwork requires knowledge beyond visual recognition, including facts about its creator, subject, material, style, collection, and historical context. Knowledge graphs can provide such evidence, but artwork KGs are incomplete, especially for newly encountered artworks. We introduce ArtKGC, a leakage-controlled multimodal benchmark and evaluation protocol for artwork knowledge graph completion. ArtKGC links artworks to Wikidata facts, Wikipedia descriptions, and visual evidence while controlling ambiguous mappings, graph leakage, and descriptions that directly reveal held-out answers. We show that graph-only models are weak for unseen artworks, raw text can inflate evaluation through answer leakage, and visual evidence is strongly relation-dependent. As an interpretable diagnostic baseline, we use a validation-calibrated reranker that combines structural, sentence-redacted textual, and visual evidence. Experiments show improved completion in the primary inductive-artwork setting and modest downstream evidence gains for artwork QA and explanation diagnostics.