End-to-end ELT pipeline for Ethiopian medical Telegram data
# Medical Telegram Warehouse
An end-to-end ELT pipeline for Ethiopian medical businesses using Telegram data.
## Stack
- Scraping: Telethon
- Warehouse: PostgreSQL
- Transformation: dbt
- Enrichment: YOLOv8
- API: FastAPI
- Orchestration: Dagster
## Data Sources
- CheMed:
t.me
- Lobelia Cosmetics:
t.me
- Tikvah Pharma:
t.me
## Setup
1. Clone the repo
2. Fill in .env credentials
3. Run pip install -r requirements.txt