ALEXIS at DialectSentEval Subtask 1 Adversarial Training and Iterative Self-Training for Zero-Shot Dialect Sentiment Analysis
Abstract
AbstractDialect sentiment analysis asks for the polarity of a sentence written in a regional Arabic variety rather than Modern Standard Arabic. We present a system for Subtask 1 of DialectSentEval built on two observations about the data. First, the task is one of zero-shot transfer rather than classification: the test set introduces Lebanese, a dialect with no labeled training data and the highest out-of-vocabulary rate in the task (52.0% of word types, against 19.5–41.0% for the seen dialects). Second, k-fold cross-validation cannot see this, since it measures generalization to unseen sentences and never to an unseen dialect. We therefore validate with a leave-one-dialect-out diagnostic and score every component on the official leaderboard. Three dialectally diverse encoders (MARBERTv2, CAMeLBERT-DA, AraBERTv2) are trained with Fast Gradient Method adversarial training, then refined by confidence-filtered self-training on the unlabeled test set and character-level noise augmentation. Adversarial training contributes +0.040 Macro F1 over a gold-only ensemble, self-training a further +0.027, and per-class pseudo-label filtering +0.018. The final system reaches 0.8667 Macro F1, ranking 1st of 12 submissions, 4.6 points above the runner-up.