Brendon1109/sarb-economic-pipeline

South African Macroeconomic Indicators Pipeline & AI Analyst # SARB Economic Pipeline A production-grade, cloud-native data pipeline for South African Reserve Bank economic indicators with AI-powered analysis. ## 🏗️ Architecture - **Bronze Layer**: Raw data ingestion (Google Cloud Storage) - **Silver Layer**: Cleaned & validated data (BigQuery) - **Gold Layer**: Analytics-ready datasets (BigQuery) - **AI Layer**: Gemini-powered economic insights - **Visualization**: Looker Studio dashboards ## 🚀 Features - Automated daily data ingestion from SARB API - Docker containerized deployment on Google Cloud Run - Apache Airflow orchestration - AI-powered economic analysis using Vertex AI Gemini - Interactive dashboards and embeddable reports ## 🛠️ Technology Stack - **Cloud Platform**: Google Cloud Platform - **Compute**: Cloud Run (serverless containers) - **Storage**: Cloud Storage + BigQuery - **Orchestration**: Apache Airflow - **AI/ML**: Vertex AI Gemini 2.5 Flash - **Visualization**: Looker Studio - **Languages**: Python, SQL - **Infrastructure**: Docker, Terraform ## 📊 Live Dashboards - Executive Summary - Economic Alerts - Correlation Analysis - Time Series Charts ## 🚀 Quick Start ### Prerequisites - Google Cloud Platform account - Docker installed - Python 3.9+ ### Local Development ```bash # Clone repository git clone github.com cd sarb-economic-pipeline # Install dependencies pip install -r requirements.txt # Run demo python demo.py ``` ### Deployment ```bash # Build and deploy to Cloud Run gcloud run deploy sarb-economic-pipeline \ --source . \ --region us-central1 \ --memory 1Gi ``` ## 📁 Project Structure ``` ├── src/ # Source code modules ├── infrastructure/ # Terraform/IaC files ├── orchestration/ # Airflow DAGs ├── analysis/ # Jupyter notebooks & reports ├── main.py # Main application ├── Dockerfile # Container configuration └── requirements.txt # Python dependencies ``` ## 🏆 K …