Alpha-Mintamir/Medical-Business-Data-Warehouse

Ethiopian Medical Business Data Warehouse A data warehouse for storing and analyzing Ethiopian medical business data scraped from Telegram channels, featuring ETL processes, YOLO object detection, and FastAPI integration. # Medical Business Data Warehouse This repository serves as a comprehensive framework for managing, analyzing, and scraping medical data. It includes various modules for data collection, processing, analysis, and storage. ## Table of Contents - Project Structure - Installation - Usage - Folder Descriptions - License ## Project Structure ``` medical-business-data-warehouse/ ├── .github/ ├── .vscode/ ├── app/ ├── data/ │ ├── photos/ │ ├── scrapped_data/ │ ├── detection_results/ │ ├── logs/ │ └── medical_data/ │ ├── analyses/ │ ├── logs/ │ ├── macros/ │ ├── models/ │ ├── seeds/ │ ├── snapshots/ │ ├── target/ │ └── tests/ ├── notebooks/ ├── scripts/ ├── tests/ ├── venv/ ├── .gitignore ├── README.md ├── requirements.txt └── dbt_project.yml ``` ## Installation To set up the project locally, follow these steps: 1. Clone the repository: ```bash git clone cd medical-business-data-warehouse ``` 2. Create a virtual environment and activate it: ```bash python -m venv venv source venv/bin/activate # On Windows use `venv\Scripts\activate` ``` 3. Install the required packages: ```bash pip install -r requirements.txt ``` ## Usage - **Run Scripts**: Navigate to the `scripts` directory and execute any script as needed. - **Data Analysis**: Use the notebooks in the `notebooks` directory for exploratory data analysis and visualization. - **Database Integration**: Use the `data` folder for managing database-related files, including photo data and YOLO detection results. ## Folder Descriptions - **.github/**: Contains GitHub-related configurations and workflows. - **.vscode/**: Visual Studio Code configurations for project setup. - **app/**: Main application logic and integration. - **data/**: - **photos/**: Directory for storing photo data. - **scrapped_data/**: Contains data collected from web scraping. - **detection_results/**: Holds results from YOLO detection processes. - **logs/**: Logs for data processing …