gishusam/kenya-econ-pipeline

# 🇰🇪 Kenya Economic Intelligence Pipeline A production-grade, end-to-end data engineering project that ingests, transforms, streams, and visualises Kenya's macroeconomic indicators in real time — built on the modern data stack. --- ## Dashboard Preview --- ## Problem Statement Kenya's economic data — GDP, inflation, and foreign exchange rates — is scattered across the World Bank, the Central Bank of Kenya, and third-party FX providers with no unified, automated data layer. Analysts manually download CSVs, reconcile different formats, and build one-off spreadsheets. Fintech and investment teams lack a reliable, always-fresh FX feed. Policy teams cannot track macro trends in near real-time. This pipeline solves that. It automates the full data journey — from raw API ingestion to a live dashboard — and produces analytical outputs no single source can provide, including Kenya's GDP expressed in KES, a real purchasing power index, and a continuously updating KES/USD time-series. --- ## Live Dashboard 🔗 **kenya-economic-intelligence.streamlit.app** --- ## What It Produces | Metric | Description | Source | |--------|-------------|--------| | GDP in KES | Kenya GDP converted from USD at live FX rate | World Bank × Open Exchange Rates | | YoY GDP growth | Year-over-year percentage change | Derived by dbt | | Inflation trend | Annual CPI rate 2020–2024 | World Bank | | Purchasing power index | Inflation + FX depreciation combined | Flagship dbt model | | Live KES/USD rate | Streamed every 60 seconds via Kafka | Open Exchange Rates | | FX daily summary | Min, max, average rate per day | Derived by dbt | --- ## Architecture ``` ┌─────────────────────────────────────────────────────────────────┐ │ Data Sources │ │ World Bank API Open Exchange Rates API │ │ (GDP, inflation) (KES/USD live rate) │ └──────────┬───────────────────────────┬──────────────────── …