Michael-py/nigeria-food-price-pipeline
Domaine:
agriculturesocioeconomicType de record:
project
Créateur:
Mic
Hôte:
An end-to-end data engineering and machine learning platform for real-time food price monitoring and forecasting across Nigerian commodity markets.
# 🇳🇬 Nigeria Food Price Intelligence Pipeline
> An end-to-end data engineering and machine learning platform for real-time food price monitoring and forecasting across Nigerian commodity markets.
---
## Problem Statement
Nigeria's food inflation exceeded 40% year-on-year in early 2025, making food affordability the country's most pressing economic challenge. Despite this, food price data remains:
- **Delayed:** NBS publishes monthly with 3–4 week lag
- **Fragmented:** Data scattered across WFP, NBS, World Bank, and market-level sources
- **Inaccessible:** No public API or dashboard serves stakeholders in real time
- **Unactionable:** No forecasting layer exists to predict price movements
This project fills that gap with a fully automated, open-source data platform.
---
## Architecture
```
┌─────────────────────────────────────────────────────────────────┐
│ ORCHESTRATION (Airflow) │
├─────────────────────────────────────────────────────────────────┤
│ │
│ ┌──────────┐ ┌──────────────┐ ┌─────────────┐ │
│ │ INGEST │──▶│ VALIDATE │──▶│ TRANSFORM │ │
│ │ │ │ │ │ │ │
│ │ - WFP │ │ Great │ │ dbt Core │ │
│ │ - NBS │ │ Expectations │ │ (staging → │ │
│ │ - World │ │ │ │ marts) │ │
│ │ Bank │ └──────────────┘ └──────┬──────┘ │
│ │ - CBN │ │ │
│ │ - Weather│ ▼ │
│ └──────────┘ ┌─────────────┐ │
│ │ STORAGE │ │
│ │ PostgreSQL │ │
│ └──────┬──────┘ │
│ …