makasimba/Shosho

Python web scraper for collecting low-resource language data to pre-train small language models. Aims to build datasets for underrepresented languages, enhancing NLP capabilities in diverse linguistic contexts. Supports creation of language-specific corpora for improved AI language understanding.