Jean1776/AFRICA-STEM-ANALYSIS

i engineered the python program and deployed robust python pandas ETL pipeline to systematically mine UNESCO Institute for Statistics National database # AFRICA-STEM-ANALYSIS i engineered the python program and deployed robust python pandas ETL pipeline to systematically mine UNESCO Institute for Statistics National database ## UNESCO Africa STEM Data Processing Script ### What This Script Does This script takes big UNESCO education data files and pulls out only the information about STEM (Science, Technology, Engineering, and Math) education in African countries. It turns messy raw data into a neat database with just what you need. ### What It Does Step by Step 1. **Finds the Data Files**: Automatically looks for three CSV files in different folders: - SDG_DATA_NATIONAL.csv (has education data for all countries) - SDG_COUNTRY.csv (has country information) - SDG_REGION.csv (has regional information) 2. **Picks Out African Countries**: Uses the region data to find which countries are in Africa and makes a list of them. 3. **Filters for STEM Topics**: Goes through the big data file in small batches (40,000 rows at a time) to find information about: - Math education - Science education - Computer and technology skills #FOR Africa_STEM_Indicators.py This script is a data engineering tool designed to process and aggregate large-scale UNESCO education data specifically focused on Science, Technology, Engineering, and Mathematics (STEM) indicators across African countries. ## What It Does The script performs the following tasks: 1. **Connects to Cloud Storage**: Accesses Google Drive to retrieve the database containing UNESCO education data 2. **Queries Large Dataset**: Processes 1.46 million rows of data from the cloud database 3. **Filters for Africa**: Uses a predefined list of 54 African country codes to ensure only relevant data is included 4. **Aggregates Data**: Groups and calculates average values for STEM indicators by country, year, and indicator type 5. **Exports Results**: Creates a lightweight CSV file suitable for use in data visualization tools like Power BI or Tableau - Student skill levels - Inte …