Ethiopian Medical Business Data Ware House :This project involves building a data warehouse to store data on Ethiopian medical businesses scraped from Telegram channel.
# Ethiopian Medical Business Data Warehouse
## Project Summary
This project involves building a data warehouse to store data on Ethiopian medical businesses scraped from Telegram channels. The project includes developing data scraping and collection pipelines, data cleaning and transformation pipelines, implementing object detection using YOLO, and designing and implementing the data warehouse. The objective is to centralize and analyze data to gain valuable insights, leading to better decision-making.
## Overview
The data warehouse aims to enhance data analysis by centralizing data, allowing comprehensive analyses to identify trends, patterns, and correlations in Ethiopian medical businesses. The project implements ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) frameworks to ensure data is clean, consistent, and ready for analysis.
## Table of Contents
- Introduction
- Business Need
- Objective
- Project Structure
- Technologies Used
- Setup and Installation
- Data Scraping and Collection
- Data Cleaning and Transformation
- Object Detection using YOLO
- API Development with FastAPI
- Learning Outcomes
- Competency Mapping
- References
## Introduction
Kara Solutions, a leading data science company, has tasked us with building a robust and scalable data warehouse to store data scraped from Telegram channels related to Ethiopian medical businesses. The data warehouse will enable the team to perform comprehensive analyses, identify trends, and gain actionable insights.
## Business Need
Kara Solutions, a leading data science company, requires a robust and scalable data warehouse to store and analyze data on Ethiopian medical businesses. The centralized data storage allows comprehensive analysis to uncover valuable insights, enabling better decision-making and efficient querying and reporting.
## Objective
The objective of this project is to:
- Develop data scraping and collection pipelines.
- Develop data cleaning and transformation pipelines …