This project aims to build a machine translation system and digital dataset for the **Igede language** spoken in Benue State, Nigeria. It's designed to support language preservation, data accessibility, and AI/ML-based translation.
# π£οΈ Igede Language Translation Project
This project aims to build a machine translation system and digital dataset for the **Igede language** spoken in Benue State, Nigeria. It's designed to support language preservation, data accessibility, and AI/ML-based translation.
## π Project Structure
- `scripts/`: Web scrapers and data cleaning tools.
- `data/raw/`: Unprocessed files from Glosbe, Bible, dictionaries.
- `data/cleaned/`: Sentence-aligned translation pairs.
- `notebooks/`: Exploration, cleaning, and visualizations.
- `models/`: Any trained model artifacts.
- `app/`: Frontend/backend code (e.g., Streamlit demo).
## Project Structure:
igede_translate_project/
β
βββ data/
β βββ raw/ # Unprocessed data (scraped text, raw Bible texts, dictionaries)
β βββ cleaned/ # Cleaned, normalized, aligned sentence pairs for training
β
βββ notebooks/ # Jupyter/Colab notebooks for prototyping and EDA
β βββ exploratory.ipynb
β
βββ scripts/ # Python scripts for automation (scraping, cleaning, aligning)
β βββ scrape_glosbe.py
β βββ align_bible.py
β βββ clean_data.py
β
βββ models/ # NMT model files, checkpoints, tokenizer config
β βββ igede_en_model/
β
βββ app/ # App backend or frontend (e.g., Flask, Streamlit)
β βββ translator_app.py
β
βββ requirements.txt # List of Python dependencies (requests, pandas, etc.)
βββ README.md # Project overview, goals, usage instructions
βββ .gitignore # To ignore cache, virtualenvs, or large files
## β
Getting Started
1. Install dependencies:
```bash
pip install -r requirements.txt