Marvellous-is-cool/yoobaai

Tone-aware Yorùbá NLP toolkit for text preprocessing, tokenization, normalization, and low-resource language AI research. # Yooba - Yorùbá NLP Toolkit 🇳🇬--- annotations_creators: - expert-generated language_creators: - found **Yooba** is a comprehensive Natural Language Processing (NLP) toolkit specifically designed for the Yorùbá language, a tonal language spoken by over 40 million people primarily in Nigeria, Benin, and Togo.language: - yo ## 🎯 Key Achievementslicense: - cc-by-nc-4.0 ### 1. **Large-Scale Yorùbá Corpus Processing** 📚multilinguality: - Successfully processed **562,238 sentences** from the Yorùbá C3 dataset- monolingual - Built a robust data pipeline handling text extraction, cleaning, and normalizationsize_categories: - Preserved linguistic integrity including tone marks (àáèéẹọṣ, etc.)- 100K