Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

Language modeling data for Swahili

Domaine:

natural language processing

Type de record:

dataset
The Swahili dataset developed specifically for language modeling task. The dataset contains 28,000 unique words with 6.84M, 970k, and 2M words for the train, valid and test partitions respectively which represent the ratio 80:10:10. The entire dataset is lowercased, has no punctuation marks and, the start and end of sentence markers have been incorporated to facilitate easy tokenization during language modeling.

Visit

zenodo.org

Connected records

paper

Tasks

language modeling

Languages

Swahili

Tags

large datasets from Lanfrica Insights

Licenses

Attribution 4.0 International

Similaires

Enhancing African low-resource languages: Swahili data for language modellingThe Shortcomings of Language Tags for Linked Data When Modeling Lesser-Known LanguagesCode-switched English Pronunciation Modeling for Swahili Spoken Term DetectionInter-Territorial Language Committee (for Swahili).taesyus/Language-Pack-Swahili-for-DiscordPlusMorpheme-based language modeling for an inflectional language — Amharic

Enhancing African low-resource languages: Swahili data for language modelling

Language modelling using neural networks requires adequate data to guarantee quality word representation which is important for natural language processing (NLP) tasks. However, African languages, Swahili in particular, have been disadvantaged and most of them are

The Shortcomings of Language Tags for Linked Data When Modeling Lesser-Known Languages

In recent years, the modeling of data from linguistic resources with Resource Description Framework

Code-switched English Pronunciation Modeling for Swahili Spoken Term Detection

Inter-Territorial Language Committee (for Swahili).

taesyus/Language-Pack-Swahili-for-DiscordPlus

# Language-Pack-Swahili-for-DiscordPlus

Morpheme-based language modeling for an inflectional language — Amharic