Naijaweb is a dataset that contains over 270,000+ documents, totaling approximately 230 million GPT-2 tokens. The data was web scraped from web pages popular among Nigerians, providing a rich resource for modeling Nigerian linguistic and cultural contexts.
Features
Data Types
text
string
link
string
token_count
int64
section
string
int_score
int64
language
string
language_probability