jovinvicent10/hydroclimate-tz

End-to-end hydrometeorological data engineering pipeline for agricultural and climate decision support in Tanzania. # HydroClimate-TZ ## End-to-End Hydrometeorological Data Engineering Pipeline for Tanzania HydroClimate-TZ is a data engineering project developed for the DSAI 6226 Data Engineering and Analytics course. The project aims to build a reproducible pipeline for acquiring, validating, transforming, storing, and serving hydrometeorological data for agricultural and climate decision support in Tanzania. ## Project Motivation Agricultural researchers, climate analysts, planners, and data scientists require reliable weather and climate information for drought monitoring, climate-risk assessment, crop modelling, early-warning systems, and machine-learning applications. Although hydrometeorological data are available from global data providers, they must be properly acquired, validated, documented, structured, and maintained before they can reliably support downstream decisions. ## Data Source The current proof-of-concept dataset is retrieved from the NASA POWER Daily API. Initial variables include: - T2M — Daily mean temperature at 2 m - T2M_MAX — Daily maximum temperature at 2 m - T2M_MIN — Daily minimum temperature at 2 m - PRECTOTCORR — Corrected precipitation - RH2M — Relative humidity at 2 m - WS2M — Wind speed at 2 m - ALLSKY_SFC_SW_DWN — Surface shortwave solar radiation ## Current Dataset Initial test location: - Arusha, Tanzania - Latitude: -3.3869 - Longitude: 36.6830 Initial time period: - 1 January 2023 to 31 December 2023 ## Initial Findings The initial dataset contains: - 365 daily observations - 12 columns - no standard missing values - no exact duplicate rows - no duplicate location-date records - no missing calendar dates Three main limitations were identified: 1. Limited spatial representativeness 2. Insufficient temporal depth 3. Source schema and units are not sufficiently self-documenting ## Repository Structure ```text hydroclimate-tz/ ├── data/ ├── docs/ ├── notebooks/ ├── reports/ ├── src/ ├── tests/ ├── README.md ├── requirements. …