Odero54/kenya-energy-pipeline

Data Analytics Platform for Kenya Energy # Kenya Renewable Energy Data Pipeline **A production-grade open-source data pipeline tracking Kenya's journey to 100% renewable electricity by 2030.** 🔗 **Live dashboard:** odero54.github.io 📁 **Repository:** github.com --- ## Objective The objective of this project is to build a fully automated, batch open-source data pipeline that ingests, transforms, and visualises Kenya's renewable energy data — making it freely accessible to energy investors, government planners, development finance institutions, researchers, and the general public. By combining data from four international open-data sources — Ember Climate, Our World in Data, IRENA, and the World Bank's EnergyData.info — the pipeline produces a live, queryable analytical layer covering Kenya's electricity generation mix, installed capacity by technology, carbon intensity, electricity access rates, and physical grid infrastructure. The dashboard rebuilds automatically every day, ensuring the data is always current. This project was built as part of the **Data Engineering Zoomcamp** by DataTalks.Club, demonstrating how modern open-source data engineering tools can be applied to real-world energy challenges in Africa. --- ## Problem Statement Kenya has made remarkable progress in renewable energy — over 91% of its electricity now comes from renewable sources, and the government has set an ambitious target of 100% renewable electricity by 2030. Yet despite this progress, a fundamental problem persists: **the data that should inform investment, policy, and planning decisions is scattered, inaccessible, and rarely visualised.** Specifically: - **Energy data is fragmented** across multiple international portals (IRENA, Ember, IEA, World Bank), each with different formats, update cycles, and access mechanisms. A policy analyst or investor wanting a complete picture of Kenya's energy system must manually download and reconcile …