fikrukidane/tsird-atlas

TSIRD Atlas: Production-grade GIS data engineering pipeline for Ethiopian spatial data (ETL, PostGIS, MapServer) # TSIRD Atlas Geospatial data engineering system for normalizing heterogeneous vector and raster datasets to EPSG:4326, validating regional bounds, and publishing via OGC WMS/WFS. Built for Ethiopian spatial data with explicit focus on Tigray regional subsetting. This system handles CRS-inconsistent shapefiles, applies YAML-driven coordinate overrides, validates geometry integrity, quarantines malformed features, and exposes normalized layers through MapServer. Architecture is Docker-based with PostGIS storage and incremental pipeline orchestration in progress. **Stack**: Python 3.11, GeoPandas, GDAL 3.8, PostGIS 16+3.4, MapServer 8.6, Docker Compose **Status**: Private portfolio repository. Source datasets and credentials excluded. --- ## Core Capabilities **Vector Processing** - CRS detection and EPSG:4326 normalization with YAML override mechanism - Geometry validation with automatic repair and quarantine logging - Bounds anomaly detection (longitude/latitude range enforcement) - Regional separation engine (Tigray vs Ethiopia-wide classification) **Raster Integration** - DEM and slope layer processing - Web raster ingestion and tiling - GDAL-based reprojection and clipping **Publication Layer** - MapServer WMS/WFS/WCS endpoints - Multi-CRS support (EPSG:4326, 20137, 3857) - PostGIS-backed layer serving **Infrastructure** - Docker Compose service orchestration - PostGIS 16 with spatial indexing - Audit trail generation (CSV + Markdown reports) - Incremental pipeline orchestration (in progress) --- ## Architecture Overview ``` Raw Data (shapefiles/rasters) | v Raw Inventory Audit - CRS detection - Geometry validity checks - Bounds anomaly detection - Audit reports (CSV/MD) | v CRS Normalization (EPSG:4326) - YAML override catalog - Reprojection + repair - Quarantine invalid features | v Regional Separation - Tigray vs Ethiopia-wide - Clip to regional bounds - Load into PostGIS (gold.*) | v MapServer Publication - WMS/WFS/WCS - Multi-CRS handling - PostGI …