wachira-samuel/SQL-End-to-End-Data-Project

This repository showcase how I used SQL to work on Health Dataset. The dataset contains patient records from different hospitals in Kenya. ## 1. Problem Statement A healthcare organization wants to transition from spreadsheet-based reporting to a database-driven reporting system. The available patient records were collected from multiple hospitals across Kenya but contain inconsistent formats, missing values, duplicates, and invalid entries. The organization requires reliable data to understand: - Hospital workload - County-level healthcare demand - Doctor workload - Treatment cost distribution - Payment reconciliation - Follow-up pressure This project demonstrates how SQL can be used to clean, standardize, transform, and analyze healthcare data to support operational and financial decision-making. ## 2. Project Objectives The objectives of this project are to: - Import raw healthcare data into PostgreSQL. - Preserve the original dataset without modification. - Validate data quality using SQL. - Clean and standardize inconsistent data. - Create reusable reporting views. - Build SQL queries to answer operational and financial questions. - Support reporting, analytics, and business decision-making. ## 3. Tools Used - PostgreSQL - SQL - DBeaver - Git - GitHub ## 4. Database Design The project follows a layered ETL (Extract, Transform, Load) approach to ensure data integrity while preserving the original source data. ```text CSV Dataset │ ▼ raw_patient_records │ ▼ clean_patient_records │ ▼ standardized_patient_records │ ▼ Reporting Views │ ▼ Analysis Queries ``` This architecture protects the raw dataset while allowing repeatable cleaning, standardization, and reporting without modifying the original data. ## 5. Data Loading The healthcare dataset was imported into a PostgreSQL database named **healthcare_operations**. A staging table named **raw_patient_records** was created to preserve the original CSV exactly as received. ## Import Summary | Metric | Value | |---------|------:| | Database | healthcare_operations | | Source File | Patient Records CSV | | Raw Table | raw_patient_records …