Logo Lanfrica

ssss

Domain:

natural language processing

Record type:

dataset
Creator:
MESBES
Publisher:
Zenodo
Host:avatar
MAGHREB-HOF: A Large-Scale Corpus for Hate and Offensive Language Detection in Maghrebi Arabic MAGHREB-HOF is a large-scale annotated corpus for hate and offensive language (HOF) detection in Maghrebi Arabic social-media text. The dataset includes dialectal Arabic, Arabizi, and code-mixed Arabic–French/English content commonly observed in North African online discussions. It is designed to support reproducible benchmarking for hate speech detection in noisy dialectal environments characterized by spelling variation, dialect mixing, and transliteration. What this record contains This Zenodo record provides: The annotated corpus of Maghrebi social-media comments (fully anonymized). The annotation guidelines used during the labeling process (PDF). A high-confidence class-balanced subset used for the main binary classification experiments reported in the companion paper. Annotation label definitions and metadata to enable reproducible experiments. Source and Data Collection Comments were collected from public social-media pages and posts relevant to the Maghrebi region. The dataset focuses on topics that frequently generate online discussions and potentially hostile interactions (e.g., politics, identity issues, sports rivalries). All released data are fully anonymized and do not include direct personal identifiers. Annotation and Labels Each comment is annotated for hate and offensive language. Binary classification labels: 0 — Clean / non-offensive 1 — Hate or offensive content When available, comments may also include fine-grained categories: Clean Hate Insult Profanity Additional metadata columns may be included to support analysis and reproducibility. See LABELS.md and the annotation guidelines for detailed definitions. Core Columns Typical dataset fields include: id — unique internal comment identifier comment — anonymized comment text label — binary label (0/1) label_multi — multi-class label (Clean / Hate / Insult / Profanity) id_annotator — annotator identifier (optional) page — source page identifier (optional) post — source post identifier (optional) post_date — publication date (optional) Recommended Use The dataset can be used to train and evaluate models for: hate and offensive language detection toxicity detection dialect-robust NLP for Maghrebi Arabic Arabizi processing code-mixed Arabic–French/English social-media text Typical evaluation protocols include cross-validation or fixed train/test splits as described in the companion paper. Ethical Considerations This dataset contains potentially harmful language, including insults and hate speech. It is released solely for research purposes to support the development of systems for detecting and mitigating harmful content. All comments are anonymized, and direct identifiers have been removed. Users of the dataset should comply with applicable ethical guidelines and regulations governing research on social-media data. License Dataset license: Creative Commons Attribution 4.0 International (CC BY 4.0) Users must provide appropriate credit and cite the companion paper and this Zenodo dataset record. Access and Embargo This Zenodo record is published with an embargo. Files will become publicly available on the date of publication of the companion article. Dataset metadata and DOI remain visible during the embargo period. Related Publication Companion article:Word and Character Models for Maghrebi Hate and Offensive Language Detection Submitted to Engineering, Technology & Applied Science Research (ETASR). Dataset Statistics Dashboard An interactive dashboard with descriptive statistics (label distribution, metadata summaries, and exploratory views) is available at: magh-arabic-hof.duckdns.org Note: The dashboard is provided for exploration and reporting and does not grant access to embargoed files. Annotation Demo (Doccano) To support peer review and demonstrate the annotation workflow, a Doccano instance is available for reviewers to explore the labeling interface on a small demo project. Doccano login page:magh-arabic-hof.duckdns.org Reviewer username:provided privately to reviewers upon request. Password: provided privately to reviewers upon request. Contact For questions or embargo-related access requests during peer review: Ahmed Zoubir MessaltiDepartment of Computer ScienceFerhat Abbas University, Sétif 1, Algeria Email: ahmedzoubir.messalti@univ-setif.dz Keywords Maghrebi Arabic; Arabizi; code-mixing; hate speech; offensive language; toxicity detection; NLP; social media corpus.