Metric-Learning Retrieval for Cross-Signer Isolated Sign Language Recognition
Abstract
AbstractWe address cross-signer Isolated Sign Language Recognition (ISLR) for Indian Sign Language as part of the WSLP-2026 shared task, where most target words have exactly one available training video and a system must recognize a query video performed by a signer never seen for that class during training. We approach this with a metric-learning encoder trained in two phases: pretraining on a large, multi-signer American Sign Language corpus to learn general signer-invariance, then fine-tuning on the target vocabulary using every real cross-signer recording we can responsibly source. Our preprocessing detects and extracts multiple performances of a word within a single recording as separate training samples, a technique not previously reported in SLR literature, and adapts a published missing-keypoint interpolation technique into a retrieval rather than classification pipeline. Our final system achieves 67.11% Top-1, 69.20% Top-5, and 70.34% Top-10 accuracy on the WSLP-2026 test-phase evaluation.