Akeab-tame/Ethiopian_Medical_Business_Data_Warehouse

This project focuses on developing a data warehouse to store information on Ethiopian medical businesses scraped from Telegram channels. The process includes building data scraping and collection pipelines, cleaning and transforming data, applying object detection with YOLO, and designing and implementing the data warehouse. # Ethiopian Medical Business Data Warehouse ## Project Summary This project focuses on developing a data warehouse to store information on Ethiopian medical businesses scraped from Telegram channels. The process includes building data scraping and collection pipelines, cleaning and transforming data, applying object detection with YOLO, and designing and implementing the data warehouse. The aim is to centralize the data for analysis, facilitating better decision-making. ## Overview The goal of this data warehouse is to centralize and streamline data analysis, enabling the identification of trends, patterns, and correlations within the Ethiopian medical business sector. The project utilizes ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) frameworks to ensure that data is properly cleaned, consistent, and ready for analysis. ## Table of Contents - Introduction - Business Need - Objective - Project Structure - Technologies Used - Setup and Installation - Data Scraping and Collection - Data Cleaning and Transformation - Object Detection using YOLO - API Development with FastAPI - Learning Outcomes - Competency Mapping - References ## Introduction Kara Solutions, a data science company, has assigned the task of building a scalable data warehouse to store data scraped from Telegram channels related to Ethiopian medical businesses. This warehouse will allow for comprehensive analysis and insights generation. ## Business Need Kara Solutions requires a centralized data warehouse to store and analyze data on Ethiopian medical businesses. This structure will support detailed analysis to uncover valuable insights, improve decision-making, and optimize reporting and query efficiency. ## Objective The key objectives of this project are: - Building data scraping and collection pipelines - Creating data cleaning and transformation processes - Implementing object detection with YOLO - Designing and deploying a data warehouse - Integrating and enriching data …