POS annotated corpus in 5 different genres for Sepedi
Domain:
natural language processingRecord type:
dataset
Creator:
Publisher:
Host:
This corpus contains POS annotated data in 5 different genres for Sepedi.
The text types included are:
- CAPS gr12 (Academic) - education.gov.za)Examinations.aspx;
- PhD Theses (Academic) - for Sepedi repository.up.ac.za;
- Magazines (Non-Academic) - CTexT acquired data from Pula Imvula;
- News (Non-Academic) - for Sepedi CTexT acquired data;
- Novels (Fiction) - SADiLaR acquired data from OUP and Shuter and Shooter.
For Sepedi, the data was tagged using the NCHLT webservices. The POS tags were then converted to the latest POS tag set (see protocol).
The data is given as txt files where each line contains a token and the corresponding POS tag, tab separated.
Each text type data file contains approximately 5,000 tokens, amounting to a total of 25,000 tokens per languages. Please see the protocols for more details on the POS tags used.
Contents: Sepedi CAPS gr12 - 6,634 tokens, Sepedi PhD Theses - 7,395 tokens, Sepedi Magazines - 5,547 tokens, Sepedi News - 8,782 tokens, Sepedi Novels - 6,924 tokens. Total Sepedi: 30,158 tokens.