asfawgedamu/Tigrinya-Dialect-Identification

This repo describes the dialect identification of Tigrinya from text using machine learning. From prior works in linguistics, we synthesized and categorized Tigrinya dialects into three (L, Z, and D). Then we systematically collected datasets for each dialect and performed experiments using classical machine learning and deep learning methods. # Tigrinya-Dialect-Identification This repo describes the dialect identification of Tigrinya from text using machine learning. From prior works in linguistics, we synthesized and categorized Tigrinya dialects into three (L, Z, and D). Then we systematically collected datasets for each dialect and performed experiments using classical machine learning and deep learning methods. The Tigrinya Dialect Identification (TDI) dataset contains text on three Tigrinya dialects or varieties namely: Z, D, and L. The purpose of this dataset is to study dialect identification for Tigrinya using machine learning. For the Z variety, we used snippets from the book ኽልተ ዛንታት (Kilte Zantatat). For the L variety, we used book chapters from ፋቶ (Fato) and ዕርቂ እንደርታ (Erqi Enderta). For the D variant, we could not find a book. Instead, we collected data from two Facebook users, Akeza Awalom and Guraya Asadi Raya that consistently write in that variety. Sentences collected for each dialect were translated to the other dialect with expert native speakers in the target dialect. ### Source by Dialect | Dialect | Source | No. sentences | |---------|----------------|---------------| | Z | Kilte Zantatat | 1041 | | L | Fato | 764 | | L | Erqi Nderta | 405 | | D | Akeza Awalom | 224 | | D | GualRaya | 530 | Acknowledgements Special thanks to Meles Solomon, who provided us with his book, ዕርቂ እንደርታ (Erqi Enderta). He also helped with translations to the L dialect. Thanks also goes to Tesfay Gebreegziabher and Gidey Gebrekidan for allowing us to use their books Fato and Kilte Zantatat respectively. Many thanks to Teklay Berhane, Abeba Asemu, Haftu Abadi, Tsegay Kinfe, Moges Bekru, Kahsay Berhe Adhana, Kibrom Mulugeta, Tsegazeab Kidanu, Tsgab Weldemariam, Abu W Debay, Solomon Shibabaw, Hagos Hiete for their valuable contributions as translators.