MKJ at SemEval-2026 Task 9: A Comparative Study of Generalist, Specialist, and Ensemble Strategies for Multilingual Polarization
Maziar Kianimoghadam Jouneghani · 2026
Read MKJ at SemEval-2026 Task 9: A Comparative Study of Generalist, Specialist, and Ensemble Strategies for Multilingual Polarization by Maziar Kianimoghadam Jouneghani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21370.txt.
Introduction
Maziar Kianimoghadam Jouneghani studies polarization spotting across 22 languages for SemEval-2026 Task 9, weighing broad generalists, local specialists, and mixed ensembles. A generalist like XLM-RoBERTa suffices when its tokenizer matches the text but struggles with distinct scripts like Khmer and Odia, where local specialists gain a lot. His adaptive system switches among the three plans by dev performance, track by track. The final system scores 0.796 macro-averaged F1 and about 83 percent average accuracy across all tracks.
Catalog record
| CREATOR | Maziar Kianimoghadam Jouneghani |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31548 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.21370
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MKJ at SemEval-2026 Task 9: A Comparative Study of Generalist, Specialist, and Ensemble Strategies for Multilingual Polarization Maziar Kianimoghadam Jouneghani Abstract We present a systematic study of multilingual polarization detection across 22 languages for SemEval-2026 Task 9 (Subtask 1), contrasting multilingual generalists with language-specific specialists and hybrid ensembles. While a standard generalist like XLM-RoBERTa suffices when its tokenizer aligns with the target text, it may struggle with distinct scripts (e.g., Khmer, Odia) where monolingual specialists yield significant gains. Rather than enforcing a single universal architecture, we adopt a language-adaptive framework that switches between multilingual generalists, language-specific specialists, and hybrid ensembles based on development performance. Additionally, cross-lingual augmentation via NLLB-200 yielded mixed results, often underperforming native architecture selection and degrading morphologically rich tracks. Our final system achieves an overall macro-averaged F1 score of 0.796 and an average accuracy of 0.826 across all 22 tracks. Code and final test predictions are publicly available at: https://github.com/Maziarkiani/SemEval2026-Task9-Subtask1-Polarization . 1 Introduction Polarization detection—identifying rhetoric that reinforces ideological division—transcends simple sentiment analysis, requiring models to parse complex socio-political nuances. SemEval-2026 Task 9 ( 19 ) introduces the POLAR benchmark ( 20 ) for this task across 22 typologically diverse languages. In this paper, we address Subtask 1 only , focusing on multilingual polarization detection across the 22 language tracks of the shared task. The central challenge is an architectural dilemma: balancing the semantic reasoning of massive multilingual generalists against the culturally grounded vocabularies of monolingual specialists. In this work, we address three central research questions: ( RQ1 ) Does XLM-RoBERTa provide a sufficient universal baseline across 22 diverse languages? ( RQ2 ) When the baseline fails, under what linguistic conditions do monolingual specialists or alternative high-capacity generalists (e.g., mDeBERTa-v3) outperform it? ( RQ3 ) Can cross-lingual data augmentation (via translation) compensate for resource scarcity? To navigate these questions, we developed a language-adaptive modeling framework. Rather than forcing a universal architecture, we established a systematic empirical policy for architecture selection (detailed in Section 3). Table 1 details our final system configurations, highlighting where generalization succeeds and where specialization is mandatory. 2 Related Work Polarization detection extends tasks like sentiment and stance analysis by requiring models to identify antagonistic rhetoric across diverse languages, scripts, and contexts. The POLAR benchmark and SemEval-2026 Task 9 formalize this challenge across 22 languages ( 19 ; 20 ) . While multilingual encoders like XLM-R ( 7 ) are standard baselines, downstream performance is not dictated by scale alone. 25 show that monolingual tokenizers often outperform multilingual ones due to varied tokenization quality across languages. This directly motivates our fragmentation analysis and comparison of generalists versus language-specific specialists. Ensembling is also a recurring strategy in competitive NLP, especially when different models exhibit complementary error profiles. The SemEval-2026 Task 9 overview reports that ensemble prediction, threshold tuning, and weighted fusion were among the most common strategies adopted by participating systems, particularly in strong submissions ( 19 ) . Similar ensemble-based approaches have also been used in recent SemEval systems for multilingual classification, where combining diverse models improves robustness across heterogeneous inputs ( 30 ) . Finally, while data augmentation addresses low-resource constraints, its efficacy is highly task-dependent. Several participating teams experimented with translation and paraphrasing ( 19 ) . However, recent work suggests synthetic data quality is highly method-dependent ( 23 ) . Consequently, our translation ablation is positioned not as a rejection of augmentation in general, but as evidence that naive forward translation was less reliable than architecture selection in our setting. Lang Code Strategy Model Details Weights & \tau Group A: Generalist Sufficiency Burmese mya Generalist mDeBERTa-v3 (Base) ( 11 ) - Nepali nep Generalist mDeBERTa-v3 (Base) - Spanish spa Generalist mDeBERTa-v3 (Base) - Swahili swa Generalist mDeBERTa-v3 (Base) - Group B: Specialist Superiority Arabic arb Specialist AraBERTv02-Twitter (Large) ( 3 ) - Bengali ben Specialist BanglaBERT (Base) ( 4 ) - Chinese zho Specialist MacBERT (Base) ( 9 ) - German deu Specialist GBERT (Base) ( 6 ) - Hausa hau Specialist Davlan/Hausa-XLMR ( 2 ) \tau=0.35 Italian ita Specialist GilBERTo ( 12 ) - Khmer khm Specialist Metythorn/Khmer-XLMR (Base) ( 24 ) - Odia ori Specialist L3Cube-Odia ( 13 ) - Telugu tel Specialist L3Cube-Telugu ( 13 ) - Group C: Hybrid Ensembles Amharic amh Ensemble Afro-XLMR ( 2 ) + mDeBERTa-v3 40/60 English eng Ensemble DeBERTa-v3 (Large) + BERTweet ( 21 ) 65/35, \tau=0.45 Hindi hin Ensemble mDeBERTa-v3 + L3Cube-Hindi-Hate ( 28 ) 50/50, \tau=0.60 Persian fas Ensemble ParsBERT ( 10 ) + mDeBERTa-v3 60/40, \tau=0.60 Polish pol Ensemble XLM-R (Base) + HerBERT ( 18 ) 50/50, \tau=0.45 Punjabi pan Ensemble mDeBERTa-v3 + XLM-R + MuRIL ( 14 ) Average Russian rus Ensemble DeepPavlov ( 15 ) + mDeBERTa-v3 50/50 Turkish tur Ensemble Savasy ( 29 ) + dbmdz ( 26 ) 50/50 Urdu urd Ensemble MuRIL (Base) ( 14 ) + XLM-R (Base) 50/50 Table 1: Final System Configuration. Ensemble weights reflect the best-performing tried development configurations, and thresholds ( \tau ) were adjusted only where beneficial. Unless explicitly stated in the table, we used the default decision threshold of \tau=0.5 . 3 Methodology 3.1 Phase 1: Architecture Selection Pipeline We established XLM-RoBERTa-Base ( 7 ) as a universal baseline across all 22 tracks. To address the subword fragmentation that standard generalists often suffer in distinct scripts (Appendix A.1 ), we maintained a comprehensive development ledger and tested between 4 and 13 candidate models or ensemble configurations per track, with deeper search in languages where more resource was available and early candidates failed to meaningfully surpass the baseline. This policy yielded improvements in 18 of 22 languages (e.g., Odia +10.6\% , Khmer +8.1\% ). However, some tracks required tactical pivots: in Burmese and Punjabi , standalone specialists underperformed, likely due to domain mismatch between formal pretraining corpora and noisy tweets; in Spanish , the specialist ( RoBERTuito ) yielded only a marginal +0.6\% gain, prompting a pivot to mDeBERTa-v3 ( +4.7\% ); and in Urdu , specialists failed to separate meaningfully from the baseline, necessitating ensembles. Notably, mDeBERTa-v3’s consistent cross-lingual performance also made it a core component in diverse tracks such as Hindi and Persian (Farsi). Through this systematic evaluation of monolingual specialists, high-capacity generalists (mDeBERTa-v3), and hybrid ensembles, a non-baseline architecture was adopted only if it improved development Macro-F1 by \geq 2\% or showed a more balanced Precision/Recall profile than the XLM-R baseline. In low-margin cases, this criterion was applied conservatively: small development-set differences were not treated as decisive unless accompanied by a more stable precision–recall trade-off. A representative sample of these transitions is detailed in Appendix A.2 . 3.2 Phase 2: Hybrid Ensembles & Calibration For languages exhibiting complementary error profiles, we constructed weighted soft-voting ensembles to leverage complementary strengths. For instance, in English , we combined a domain-specific social media model (BERTweet) with a general-purpose encoder ( DeBERTa-v3-Large ( 11 ) ). The ensembled probability is calculated as P(x)=\alpha P_{Spec}(x)+(1-\alpha)P_{Gen}(x) , where \alpha\in[0,1] denotes the specialist weight in the soft-voting mixture (generalized to an unweighted mean for architectures with >2 models such as Punjabi ). In practice, ensemble configurations were explored as part of the broader development-phase search (Section 3.1). The reported weights therefore correspond to the best-performing tried configurations on the development set rather