Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Gradient Descenders at DialectSentEval 2026: A Comparative Study of Pretrained Arabic Transformers for Multi-Dialect Sentiment Analysis

AbstractThis paper presents the Gradient Descenders system for DialectSentEval Subtask 1 on multi-dialect Arabic sentiment analysis. Because general-purpose models often miss dialectal nuances, we compare three pretrained encoders with distinct linguistic orientations: MARBERTv2, DarijaBERT, and AraBERT. We formulate the task as three-class classification, employing a parameter-efficient head-only adaptation strategy that freezes encoder parameters. Our results show MARBERTv2 outperforms the others, achieving a Macro F1 of 80.11% and Accuracy of 81.90%, securing fifth place overall. These findings emphasize that backbone selection is critical; specifically, broad dialect-oriented pretraining yields the most transferable representations for multi-dialect generalization.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Interdisciplinary and Natural Language Processing

More from EMNLP 2026

All EMNLP 2026 papers →