Andrews2017/africanlp-public-datasets

A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages. # AfricaNLP-Public-Datasets A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages. # Datasets per task (Randomly ordered) ## Machine Translation - TANZIL: A translated Quran to 42 languages, including African languages such as Amharic, Hausa, Somali, and Swahili. - MENYO-20k: A Yorùbá-English multi-domain parallel text dataset. - FFR: A Fon-French parallel text dataset. - Hausa Corpus: A Hausa-English parallel text dataset. - CCAligned: A parallel text dataset for English and 137 languages, including 30 African Languages. - ParaCrawl: A parallel text dataset for 41 languages, including Somali and Swahili. - WikiMatrix: A parallel text dataset for 85 languages, including Swahili, Malagasy, and Egyptian Arabic. - Ethiopian MT datasets: A parallel text dataset for English paired with 7 Ethiopian languages. - English-Luganda: An English-Luganda parallel text dataset. - French-Fon and French-Ewe: A parallel text dataset for French paired with Fon and Ewe. - Amharic-English: An Amharic-English parallel text dataset. - Tigrinya-English: A Tigrinya-English parallel text dataset (Free registration required). - Lingala-French: A Lingala-English parallel text dataset (Free registration required). - Congolese Swahili-French (Min,Small,Medium): Congolese Swahili-French parallel text datasets (Free registration required). - Swahili-French: A synthetic Swahili-French parallel text dataset (Free registration required). - English-Hausa (Min, Small): English-Hausa parallel text datasets (Free registration required). - English-Swahili: An English-Swahili parallel text dataset (Free registration required). - English-Swahili: An English-Swahili textdatasets on two separate files (Free registration required).229,312-Pairs - English-Kanuri: An English-Kanuri parallel text dataset (Free registration required). - English-Akuapem Twi: An English-Akwapem Twi parallel text dataset. - FLORES-101: A parallel text data …