SimbaMaw1547/south-african-monolingual-corpora-jsonl

Domain:

natural language processing

Record type:

dataset

Creator:

Sim

Host:

This dataset contains pretraining text data for 9 South African languages, compiled from multiple sources including CC100, Glot500, mC4, ParaCrawl, and various corpora collections. The datasets were gathered as part of the University of Cape Town's SALLM project. Where data was gathered from multiple sources, extensive filtering and deduplication was conducted to ensure dataset integrity Languages Included

Visit

huggingface.co

Tasks

language modeling

SimbaMaw1547/south-african-finetuning

This dataset collection contains various NLP tasks for South African languages, organized by task an

Autshumato Setswana Monolingual Corpora

Setswana monolingual corpus as a deliverable of the Autshumato project. The data is given as a UTF-8

Autshumato Xitsonga Monolingual Corpora

Xitsonga monolingual corpus as deliverable of the Autshumato project. The data is given as a UTF-8 t

11_Corpus_Contenu_BurkinaFaso405.jsonl

Contenu des articles de presse ('texte'), y compris leurs titres, et l’identifiant unique ('id') cor

On Using Monolingual Corpora in Neural Machine Translation

Recent work on end-to-end neural network-based architectures for machine translation has shown promi

Unsupervised Cross-Lingual Part-of-Speech Tagging with Monolingual Corpora Only

Due to the scarcity of part-of-speech annotated data, existing studies on low-resource languages typ