Logo Lanfrica

michsethowusu/African-Language-Parallel-Sentences-Collection

Domain:

natural language processing

Record type:

dataset
Creator:
mic
Host:
This dataset collection includes sentence pairs for African languages along with similarity scores. # African Language Parallel Sentences Collection This dataset collection includes sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks. This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1. Below is a table listing the language pairs and their counts: | Language Pair | Total Sentence Pairs | |---------------|----------------------| | Afrikaans-Akan | 96786 | | Afrikaans-Amharic | 2084061 | | Afrikaans-Bambara | 121707 | | Afrikaans-Bemba | 340946 | | Afrikaans-Chichewa | 1149573 | | Afrikaans-Dinka | 113793 | | Afrikaans-Dyula | 130823 | | Afrikaans-Ewe | 603861 | | Afrikaans-Fon | 250256 | | Afrikaans-Fulah | 168993 | | Afrikaans-Ganda | 477039 | | Afrikaans-Hausa | 1915829 | | Afrikaans-Igbo | 820401 | | Afrikaans-Kamba | 99195 | | Afrikaans-Kikuyu | 127764 | | Afrikaans-Kimbundu | 115415 | | Afrikaans-Kinyarwanda | 1042316 | | Afrikaans-Kongo | 199797 | | Afrikaans-Lingala | 346128 | | Afrikaans-Nuer | 51337 | | Afrikaans-Oromo | 471696 | | Afrikaans-Pedi | 408589 | | Afrikaans-Rundi | 538952 | | Afrikaans-Shona | 1293875 | | Afrikaans-Somali | 1432523 | | Afrikaans-Swahili | 2454143 | | Afrikaans-Swati | 184251 | | Afrikaans-Tigrinya | 454330 | | Afrikaans-Tsonga | 554518 | | Afrikaans-Tswana | 779255 | | Afrikaans-Tumbuka | 407317 | | Afrikaans-Twi | 567621 | | Afrikaans-Umbundu | 205246 | | Afrikaans-Wolof | 237043 | | Afrikaans-Xhosa | 1361566 | | Afrikaans-Yoruba | 1775488 | | Afrikaans-Zulu | 1771278 | | Akan-Amharic | 101523 | | Akan-Bambara | 14267 | | Akan-Bemba | 34555 | | Akan-Chichewa | 52335 | | Akan-Dinka | 13572 | | Akan-Dyula | 19101 | | Akan-Ewe | 64269 | | Akan-Fon | 46382 | | Akan-Ful …