Logo Lanfrica
  • Home
  • Atlas
  • Insights
  • Docs
  • Sign in

© 2026 Lanfrica. All rights reserved. All copyrights of the resources shown on the Lanfrica website belong to the original copyright holders, unless explicitly stated otherwise.

Enhancing text pre-processing for Swahili language: Datasets for common Swahili stop-words, slangs and typos with equivalent proper words

Domain:

natural language processing

Record type:

paper
Natural Language Processing requires data to be pre-processed to guarantee quality models in different machine learning tasks. However, Swahili language have been disadvantaged and is classified as low resource language because of inadequate data for NLP especially basic textual datasets that are useful during pre-processing stage. In this article we develop and contribute common Swahili Stop-words, common Swahili Slangs and common Swahili Typos datasets. The main source for these datasets were short Swahili messages collected from Tanzanian platform that is used by young people to convey their opinions on things that matters to them. Therefore, we derive list of common Swahili stop-words by reviewing most frequent words that are generated with Python script from our corpus, review common slang with help of Swahili experts with their corresponding proper words, and generate common Swahili typos by analysing least frequent words generated by a Python script from corpus. The datasets were exported into files for easy access and reuse. These datasets can be reused in natural language processing as resources in pre-processing phase for Swahili textual data.

Visit

pubmed.ncbi.nlm.nih.govwww.sciencedirect.com

Connected records

datasetdatasetdataset

Tasks

stopwordstext normalization

Languages

Swahili

Similar

Common Swahili Stop-wordsNew Common Swahili Stop-WordsNeurotech-HQ/common-swahili-slangs-typosCommon Swahili TyposCommon Swahili SlangsNew Common Swahili Slangs

Common Swahili Stop-words

Common Swahili stop-words dataset consist a list of words which does not add much meaning to a sentence, hence can be ignored without sacrificing the meaning of the sentences.

New Common Swahili Stop-Words

New updated list of Common Swahili stop-words dataset consist a list of words which does not add muc

Neurotech-HQ/common-swahili-slangs-typos

Common Swahili stopwords, slangs and typos dataset # common-swahili-slangs-typos Common Swahili st

Common Swahili Typos

Lists of Swahili typos with their respective proper words are lowercased and comma separated. typoswill be replaced by its respective proper word so as to maintain consistence during vectorization to form vectors that are used in training Machine Learning algorithm

Common Swahili Slangs

Lists of Swahili Slangs with their respective proper words are lowercased and comma separated. Slangs will be replaced by its respective proper word so as to maintain consistence during vectorization to form vectors that are used in training Machine Learning algori

New Common Swahili Slangs

New updated list of Swahili Slangs with their respective proper words, the dataset are lowercased an