Logo Lanfrica

tchernodawda/awesome-wolof-nlp

Domaine:

natural language processing

Type de record:

dataset
Créateur:
tch
Hôte:
A curated list of resources for Natural Language Processing (NLP) in Wolof and related West African languages. # Awesome Wolof NLP Wolof is spoken by approximately 10 million people, primarily in Senegal, Gambia, and Mauritania. Despite this, NLP resources remain very scarce. This repo catalogs everything that exists — datasets, models, tools, papers — with comments to help you choose the right resource for your use case. **Contributions welcome!** See CONTRIBUTING.md. ## Contents - Datasets - Models & Embeddings - Tools - Papers & Research - Groups & Labs - Related Languages - General African NLP Resources ## Datasets ### Parallel Corpora - **JW300** — Wolof–French parallel corpus extracted from religious publications. ~300k aligned sentences. Good lexical coverage, but register is formal and thematically narrow (religion). Widely used as a baseline. - **FLORES-200** — Meta's multilingual benchmark including Wolof (code `wol`). 1,012 sentences translated from English. Ideal for evaluating translation models, but too small for training. - **OPUS Wolof** — Aggregator of parallel corpora. Search `wol` to browse all available language pairs (Wolof–EN, Wolof–FR, etc.). Quality varies by source. - **Common Voice Wolof** — Mozilla's crowdsourced audio corpus for speech recognition. A few hours of speech validated by native speakers. Still growing — **you can contribute!** - **Tatoeba Wolof** — Short collaboratively translated sentences. Low volume (~500 sentences) but clean, human-verified data. ### Monolingual Corpora - **Wolof Wikipedia** — ~1,400 articles. Small but useful for text mining. Downloadable via Wikimedia Dumps. - **Leipzig Corpora Collection – Wolof** — Monolingual corpus collected from the web (~100k sentences). Useful for language modeling. ### Lexicons & Dictionaries - **Panlex Wolof** — Multilingual lexical database including Wolof. Useful for building dictionaries or translation resources. - **Wolof CLDR Data (Unicode)** — Unicode localization data including some Wolof entries (month names, country names, etc.). ## Models & Embeddings - …

Languages