Logo Lanfrica

alsenlegesse-bit/medical-telegram-warehouse-final

Domain:

healthcare

Record type:

software
Creator:
als
Host:
Complete end-to-end data pipeline for Ethiopian medical businesses from Telegram data # Medical Telegram Warehouse - Final Submission Complete end-to-end data pipeline for Ethiopian medical businesses, extracting insights from Telegram channels. ## 🎯 Project Overview This project implements a modern ELT (Extract, Load, Transform) pipeline for analyzing Ethiopian medical business data from Telegram channels. The system extracts data from public Telegram channels, transforms it into analytical models, enriches with computer vision, and exposes insights through an API. ## 📋 Tasks Completed ✅ **Task 1**: Data Scraping and Collection ✅ **Task 2**: Data Modeling and Transformation (dbt) ✅ **Task 3**: Data Enrichment with YOLO Object Detection ✅ **Task 4**: Analytical API with FastAPI ✅ **Task 5**: Pipeline Orchestration with Dagster ## 🏗️ Architecture ``` Raw Data (Telegram) → Data Lake → PostgreSQL → dbt Transformations → Star Schema → YOLO Enrichment → FastAPI → Dagster Orchestration ```

Languages