Pogayo/ADH-EN_MT_Dataset

Contains Adhola-English parallel sentences that can be used for Machine Translation. # ADH - ENG LANGAUGE DATASET ## About This repository contains Dhopadhola and English Sentences that can be used for Machine Translation. The text comes from several domains and was scrapped from different sources online and in print media. I did this as part of my submission for AI4D Language Dataset Challenge Round 2. My submission was not selected but I have decided to make the data open source for anyone to use as that was my initial goal and that of the challenge. > NLP, Machine Translation, Africa, Uganda ## Table of Contents - About Dataset - Repo Structure - Contributing - Team - Support - License ## About Dataset This dataset was created to provide Dhopadhola(ADH) to English Parallel sentences to help in availing services that require Natural Language Processing to Dhopadhola speakers. The dataset can be used for Machine Translation purposes. It consists of 2484 parallel (Dhopadhola and English) sentences from different domains and 3386 monolingual Dhopadhola sentences. Both Supervised and Semi-supervised MT can utilise this dataset. The dataset can also be used to study transfer learning in related African languages as it is closely related to Dholuo spoken in Kenya & Tanzania, Acholi, Lango and Alur in Uganda and other Luo languages. Dhopadhola is a very low resourced language; it has very few resources available publicly on the internet and even in other print media. This dataset is will help in the availability of Dhopadhola in digital media as when the task for which it is intended for(Machine Translation) is implemented, more resources will be translated into the language and also the native speakers will be incentivized to use it online eg on social media because non-speakers can get the translations. ### Dataset Composition Get the most updated information from the datasheet ## Repo Structure This repo contains 3 main folders of interest. ### 1. Clean language data Contains all the text combined from different source files. Datashee …