WolofProcessing/online_wolof_data

Curate online wolof text resources that can be used to build models # Online Wolof Data This repository tracks and centralizes all `openly accessible datasets` as well as potential `data sources` on the `Wolof` language. For more information on NLP work done in the remaining national languages, see this repository. ## Text Data ## | `Machine Translation` | `Token Classification` | `Question Answering / Instruct / Pre-training` | `Text Classification` | | :---------------------| :--------------------------| :------------------------|:---------------------| | OPUS | MasakhaNER | AfriQA | Masakhane-NLU (Iroko+NLU) | | | FLORES-200 | MasakhaPOS | Aya (Includes AfriQA) | Hate Speech Detection | | Microsoft NTREX | UD_Wolof-WTB | AfriWOZ 1.0 | WolBanking77| | LORELEI (payant) | | Belebele | CommonLingua LID | | MAFAND-MT | | FineWeb 2 | AfrIFact| | Google-SMOL | | Wolof Dataset for Open LLM Fine-Tuning | | | MADLAD-400 | | | | | FineTranslations | | | | | `Wolof books (non exhaustive list)` | | :-----------| | Bataaxal bu gudde nii (Une si longue lettre), _Mariyaama Ba_ | | Doomi golo (Le fils de la guenon), _Bubakar Bόris Jόob_ | | Goneg nit ku nuul gi (L'enfant noir), _Camara Laye_| | Ndoomu Buur Si (Le petit prince), _Antoine de Saint Exupery_| | Bàmmeelu Kocc Barma, _Buubakar Bóris Jóob_| | Puukare, _Ceerno Séydu Sàll_| | Doxandéem, _Ibraayima Saaxo Caam_| | `Ajami and Arabic` | | :-----------| | MudawanSn: A Gold-Standard Wolof--Arabic Parallel Corpus for Machine Translation | | AHDQ: (Arabic Handwriting Dataset from Quran) | | Ajami X Translit | | Wolof Ajami OCR augmented | ### `Wolof web sites` | `Online news & Docs` | `Religious content` | `Medical content` | `Learning Wolof` | `Twitter accounts` | | :--------------------| :------------------| :-----------------| :-----------------| :----------------| | Defu Waxu | Nouveau Testament | InfoVIHTal | Jàng Wolof | Saabal| | Wolof-online | Bible | | | WaxWolof | | Wikipedia| The words | | Yoonu njub | | Jeovah Witnesses ## Audio Data ## | `Automatic Speach Recogn …