turinaf/Sagalee

Automatic Speech Recognition Dataset for Oromo Language ## Sagalee: Automatic Speech Recognition Dataset for Oromo language Sagalee dataset is released under Attribution-NonCommercial 4.0 International license. The license details can be found here. Paper is now available on arxiv: Sagalee: an Open Source Automatic Speech Recognition Dataset for Oromo Language ## News - 🎉 [2024-12-20] Sagalee paper accepted to ICASSP 2025 Conference - ✨ [2024-11-28] Sagalee dataset released under CC BY-NC 4.0 International license. ## Dataset Acess - The dataset on OpenSLR: openslr.org - On Huggingface: turinaf/Sagalee Using huggingface `datasets` library ```python from datasets import load_dataset sagalee_ds = load_dataset("turiabu/Sagalee") print(sagalee_ds) ``` ## Training ASR on Sagalee Dataset ### Clone this Repo ``` git clone github.com cd sagalee git submodule update --init --no-fetch ``` ### Create env and install dependancy ``` conda create -n wenet python=3.10 conda activate wenet conda install conda-forge::sox pip install torch==2.2.2+cu121 torchaudio==2.2.2+cu121 -f download.pytorch.org ``` ``` cd wenet pip install -r requirements.txt ``` ## Training recipes ### 1 Prepare the data. Running the script `prepare_wenet_data.py` will prepare data in required format inside `wenet/examples/sagalee/s0/data/`. It organize the wav files and text files into two files. `wav.scp` containing two tab-separated columns with `wav_id` and `wav_path` and `text` containing two tab-separated columns `wav_id` and `text_label` `wav.scp` file: ``` sagalee_SPKR232_122 sagalee/train/SPKR232/sagalee_SPKR232_122.wav sagalee_SPKR232_002 sagalee/train/SPKR232/sagalee_SPKR232_002.wav ``` `text` file ``` sagalee_SPKR232_082 HOJJATAA JIRA JECHUUN KOMATE sagalee_SPKR232_093 SAMMUU KEE KEESSA HIN KAAYANI ``` ### 2 Run the training After preparing data, navigate to the directory containing `run.sh`, and simply run the stages starting from stage 1. ``` cd wenet/exam …