Skip to content
conftrace_
2026 EMNLP EMNLP 2026

faisalm93 at DialectSentEval 2026: A Five-Fold MARBERTv2 Ensemble for Arabic Dialect Sentiment Analysis

AbstractWe describe our submission to DialectSentEval 2026 Subtask 1, a three-class sentiment task covering Moroccan, Egyptian, Lebanese, Jordanian, and Saudi Arabic. Our system fine-tunes MARBERTv2 in five stratified folds and averages their test probabilities. Using raw text without explicit dialect conditioning or external task-specific data, the official submission obtained 0.7939 macro-F1, 0.8152 accuracy, 0.7917 macro precision, and 0.7987 macro recall, ranking eighth among twelve systems in the supplied snapshot. Separately, a post-submission character 3-5-gram diagnostic falls from 0.9157 OOF macro-F1 with row-stratified folds to 0.7520 when repeated ID-label groups and normalized duplicates are kept together. This result establishes dataset-level split sensitivity; it does not quantify the effect on MARBERTv2. We document the submitted configuration, a group-aware diagnostic protocol, and the experiments still needed to isolate the effects of strict splitting and ensembling on the transformer system.

More from EMNLP 2026

All EMNLP 2026 papers →