emmanuel2406/web-corpus-for-african-languages

# Web Corpus for african languages Created by Emmanuel Rassou Info Doc can be accessed here **Warning:** This web scraping tool mostly outputs links in the foreign language, and each one should be verified by a human before adding to the sheet. ## How to use > Step 1: Setup up Python environment\ >`python -m venv .myenv` \ >`source .myenv/bin/activate` \ >`pip install -r requirements.txt` > Step 2: Add Openai API key in a .env file\ > You will need to supply your own OpenAI credits. > Step 3: Change topics and languages in `configs.py` \ > Can also change some of the hyperparameters in `main.py`. > Step 4: Run tool with `python main.py`