Skip to content
conftrace_
2026 AACL AACL 2026

Modality-Specific and Relation-Aware Modeling for Scientific Figure Linking

AbstractWe present a modality-specific system for the AstroCLIMB shared task, which predicts relations among astronomical figures and captions. Caption–caption, image–image, and image–caption pairs use different combinations of frozen pretrained representations and supervised classifiers. Image–caption prediction first applies a Qwen3-VL 4B/8B exact correspondence gate before classifying the remaining paper relations. Subsequent improvements add astronomy-domain sentence embeddings to the caption branch and a learned visual-projection specialist to the image branch. Across eight Kaggle submissions, macro-F1 increases from 0.3641 to 0.6096. Adding astronomy-specific caption features improves five-fold pooled out-of-fold (OOF) macro-F1 from 0.6071 to 0.6388; the image specialist offers a smaller incremental test-set gain. The direct citation relation, related_papers, remains the most difficult. Results support selecting representations and decision mechanisms according to modality, while highlighting the limitations of recovering citation links from isolated content.

More from AACL 2026

All AACL 2026 papers →