NAMAA Community at DialectSentEval 2026 Subtask 1: Dialect-Aware Arabic Sentiment Classification with Pretrained Transformer Models
Abstract
AbstractArabic dialect sentiment analysis is challenging because regional varieties show considerable lexical, morphological, syntactical, and orthographic variation. This paper presents a transformer-based system developed for DialectSentEval 2026 Subtask 1, a three-class sentiment classification task covering Moroccan, Egyptian, Jordanian, and Saudi Arabic. The system independently fine-tunes three pretrained Arabic language models: AraBERTv2, MARBERTv2, and CAMeLBERT, using a common training protocol. The implementation uses an 80/20 stratified train-validation split, a maximum sequence length of 128, a batch size of 16, a learning rate of 2 × 10-5, and focal loss with 𝛾=2=2. Model selection was conducted based on validation macro F1. Using the published labeled test set, MARBERTv2 achieves the strongest independent result with 94.07% macro F1, followed by CAMeLBERT at 81.96% and AraBERTv2 at 79.77%. The results demonstrate the importance of Arabic pretraining and dialect-oriented representations and establish MARBERTv2 as the strongest standalone backbone in the current system.