Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

POLAR: A Benchmark for Multilingual, Multicultural, and Multi-Event Online Polarization

Domaine:

natural language processing

Type de record:

paperdataset
Créateur:
NasGeiRenKoh
Hôte:avatar
Online polarization poses a growing challenge for democratic discourse, yet most computational social science research remains monolingual, culturally narrow, or event-specific. We introduce POLAR, a multilingual, multicultural, and multi-event dataset with over 110K instances in 22 languages drawn from diverse online platforms and real-world events. Polarization is annotated along three axes, namely detection, type, and manifestation, using a variety of annotation platforms adapted to each cultural context. We conduct two main experiments: (1) fine-tuning six pretrained small language models; and (2) evaluating a range of open and closed large language models in few-shot and zero-shot settings. The results show that, while most models perform well in binary polarization detection, they achieve substantially lower performance when predicting polarization types and manifestations. These findings highlight the complex, highly contextual nature of polarization and demonstrate the need for robust, adaptable approaches in NLP and computational social science. All resources will be released to support further research and effective mitigation of digital polarization globally. Preprint

Visit

arxiv.org

Tasks

text classification

Tags

Computation and Language

Similaires

Macaron: A Controlled, Human-Written Benchmark for Multilingual and Multicultural Reasoning via Template-FillingGlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language ModelsMacaron: Controlled, Human-Written Benchmark for Multilingual and Multicultural Reasoning via Template-FillingLet's Play Across Cultures: A Large Multilingual, Multicultural Benchmark for Assessing Language Models' Understanding of SportsXTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual GeneralizationAmharicStoryQA: A Multicultural Story Question Answering Benchmark in Amharic

Macaron: A Controlled, Human-Written Benchmark for Multilingual and Multicultural Reasoning via Template-Filling

Evaluating whether large language models (LLMs) genuinely understand the world from a non-English pe

GlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language Models

Large Audio-Language Models (LALMs) integrate audio perception and language understanding within a u

Macaron: Controlled, Human-Written Benchmark for Multilingual and Multicultural Reasoning via Template-Filling

Multilingual benchmarks rarely test reasoning over culturally grounded premises: translated datasets

Let's Play Across Cultures: A Large Multilingual, Multicultural Benchmark for Assessing Language Models' Understanding of Sports

Language Models (LMs) are primarily evaluated on globally popular sports, often overlooking regional

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

The Cross-lingual Natural Language Inference (XNLI) corpus is a crowd-sourced collection of 5,000 test and 2,500 dev pairs for the MultiNLI corpus. The pairs are annotated with textual entailment and translated into 14 languages: French, Spanish, German, Greek, Bu

AmharicStoryQA: A Multicultural Story Question Answering Benchmark in Amharic

With the growing emphasis on multilingual and cultural evaluation benchmarks for large language mode