TsegayIS122123/medical-telegram-warehouse

End-to-end data pipeline for Ethiopian medical Telegram channels - from raw data scraping to analytical API with dbt transformations, YOLO image detection, and Dagster orchestration. # 🏥medical-telegram-warehouse End-to-end data pipeline for Ethiopian medical Telegram channels - from raw data scraping to analytical API with dbt transformations, YOLO image detection, and Dagster orchestration. >## 📋 Project Overview ### The Business Problem Ethiopian pharmaceutical companies lack visibility into competitor activities, product mentions, and market trends across Telegram - the country's primary social commerce platform. Manual monitoring is time-consuming and misses critical insights. ### The Solution This platform automates the collection and analysis of medical Telegram data, providing: - **Market Intelligence**: Track 45+ product mentions across 3 competitor channels - **Visual Insights**: Analyze 17 product images with computer vision - **Engagement Metrics**: Monitor views, forwards, and content performance - **Operational Efficiency**: Replace 40+ hours of manual work with automated pipelines This project builds a data platform that: 1. **Extracts** data from Ethiopian medical Telegram channels 2. **Transforms** raw data into analysis-ready star schema using dbt 3. **Enriches** with YOLO object detection on images 4. **Serves** insights through a FastAPI analytical API 5. **Orchestrates** with Dagster for production workflows ## 🌐 **LIVE DEMO** | Service | URL | Status | |---------|-----|--------| | **API Documentation** | medical-telegram-api.onrend… | | **Interactive Dashboard** | medical-telegram-dashboard.… | | **API Health Check** | medical-telegram-api.onrend… | ## 🏗️ Architecture Telegram Scraping → Data Lake (JSON/Images) → PostgreSQL → dbt Transformations → Star Schema → FastAPI → End Users ↑ Image Processing & YOLO Detection ## 💼 BUSINESS IMPACT - 📊 **Real-time monitoring** of competitor activity - 🎯 **Data-driven marketing** decisions based on engagement patterns - 💰 **Cost savings** through automated data collection - 📈 **Competitive advantage** with faster …