A pipeline for harmonizing Tunisian agricultural datasets, resolving Arabic/French regional naming inconsistencies, linking data to administrative boundaries, and generating GIS-ready spatial layers.
# Tunisian Agricultural Data Harmonization & GIS Pipeline
This is a data processing and geospatial pipeline for transforming raw Tunisian agricultural datasets into standardized, GIS-ready spatial layers.
The project focuses on **data harmonization, metadata, administrative-region matching, and spatial transformation** of agricultural datasets related to Tunisia. It was developed as part of the **Smart SDG Tunisia – Manouba School of Engineering 2026 internship**.
## Overview
Tunisian agricultural datasets can be valuable for statistical analysis while still being difficult to use directly in GIS applications. Common issues include:
* Inconsistent administrative region names
* Arabic/French naming differences
* Missing or inconsistent geographic identifiers
* Different field structures and units
* Non-spatial datasets without coordinates
* Lack of standardized links between statistical data and geographic boundaries
We will provides a workflow to clean and harmonize these datasets and transform them into spatial layers suitable for visualization and analysis in **QGIS, ArcGIS, or other GIS software**.
## Objectives
The project aims to:
* Normalize inconsistent regional naming across agricultural datasets.
* Resolve Arabic and French administrative naming conflicts.
* Create a unified `region_id` for geographic matching.
* Link statistical agricultural datasets with Tunisian administrative boundaries.
* Convert non-spatial agricultural data into GIS-compatible formats.
* Generate reproducible spatial layers for GIS visualization and analysis.
* Provide metadata describing datasets, variables, geographic references, transformations, and output quality.
## Data Sources
The workflow is designed around agricultural datasets obtained from the **ONAGRI-related data catalog**.
The datasets cover 6 categories:
* Forests
* Animal production
* Land development
* Dams & irrigated areas
* Rainfall
* Agricultural products
The raw datasets are organized by category before …