jonnahjr/EthioMart-NER-Week5

EthioMart is a project aimed at developing an Amharic Named Entity Recognition (NER) system to extract key business entities—such as product names, prices, and locations—from Telegram-based e-commerce messages. # EthioMart - Named Entity Recognition for Amharic E-commerce Data ## Overview EthioMart, a growing hub for Telegram-based e-commerce in Ethiopia, aims to consolidate multiple independent e-commerce channels into a single centralized platform. With the increasing use of Telegram for business transactions, customers and vendors are currently spread across various channels, leading to challenges in product discovery, communication, and order management. This project focuses on building an **Amharic Named Entity Recognition (NER) system** to extract important business entities—such as product names, prices, and locations—from the messages shared in these Telegram channels. The extracted data will be used to populate EthioMart's centralized database, providing a seamless and organized shopping experience for customers and a unified platform for vendors. ## Key Objectives 1. **Real-time Data Extraction**: Fetch data from various Ethiopian Telegram e-commerce channels. 2. **Fine-tuning Large Language Models (LLMs)**: Adapt existing LLMs to accurately extract business entities like product names, prices, and locations from Amharic text. ## Project Structure The project is organized as follows: ```bash ├── .github/ │ ├── workflows/ │ ├── ci-cd.yml ├── data/ │ ├── modern_Data.csv │ ├── labeled_data.txt ├── notebooks/ # Jupyter notebooks for analysis, experiments, and exploration │ ├── KAIM-Week-5-task-2.ipynb │ ├── Bert-Model.ipynb │ ├── Distilbert-Model.ipynb │ ├── XLM-Roberta-Model.ipynb ├── ner_files/ │ ├── data_utils.py │ ├── preprocess.py │ ├── metrics.py │ ├── model_utils.py │ ├── main.py ├── scripts/ │ ├── main.py │ ├── preprocess.py │ ├── scraper.py ├── src/ # Source code for different project modules │ ├── data_loading.py │ ├── data_preprocessing.py │ ├── data_labelling.py ├── tests/ # Unit tests for code modules │ └── test_data_loading.py ├── requirement …