Sabaa at DialectSentEval Shared Task Subtask-2: Classifier-Guided Candidate Reranking for Arabic Dialectal Sentiment Swap
Abstract
AbstractSentiment swap asks a system to rewrite a sentence so that its polarity is inverted while everything else stays the same, two halves of an instruction that pull against each other. This paper describes how the Sabaa system navigates that trade-off for Arabic dialects in Subtask 2 of DialectSentEval 2026. Rather than asking one model for a single correct rewrite, we ask two fine-tuned Arabic sequence-to-sequence models to each propose several, then choose among the pooled proposals with a scoring function built from the signals the task grades us on. The system scores 49.07 BLEU, 69.33 chrF, and 0.7447 sentiment accuracy on the official test set. That last figure is the most informative result here: the system places 90.37% of its outputs at the polarity it was aiming for, and the shortfall traces to inferring each sentence’s original polarity, which the test data withholds. Measured against gold labels on development, that inference is correct only 74.07% of the time, and sixteen points of sentiment accuracy separate our submission from a perfect estimator.