ud-shalom/Okoli-Udoka-Shalom-AnalystLab-Africa-Week-7-Project
Type de record:
project
Créateur:
ud-
Hôte:
A Python ETL pipeline that extracts real-time weather data from the OpenWeather API, transforms it using Pandas, and loads it into a CSV file for analysis.
# 🌤️ Weather Data ETL Pipeline
## 📝 Project Overview
This project demonstrates the automation of a data pipeline using Python. I built an **ETL (Extract, Transform, Load)** process to collect real-time weather data from the OpenWeather API, process it, and store it for analysis. 🚀
---
## 🛠️ Tools Used
- 🐍 **Python** – The core programming language.
- 📊 **Pandas** – For data transformation and organization.
- 🌐 **Requests** – To interact with the OpenWeather API.
- 💻 **Google Colab (Jupyter Notebook)** – Development environment.
---
## 🔄 The ETL Process
### 📥 1. Extract
- Connected to the OpenWeather API using an API key.
- Retrieved real-time weather data for:
- Port Harcourt
- Accra
- Cape Town
### ⚙️ 2. Transform
- Converted the raw JSON data into a structured Pandas DataFrame.
- Selected the required fields:
- City
- Temperature
- Humidity
- Weather Condition
- Wind Speed
- Date & Time
- Added a timestamp for accurate record-keeping.
### 💾 3. Load
- Saved the cleaned and processed dataset as **`weather_data.csv`** for future analysis and reporting.
---
## 💡 Key Insights
- 🌡️ **Temperature:** Observed noticeable climate differences across the three cities.
- 💧 **Humidity:** Cape Town recorded the highest humidity among the selected cities.
- ☁️ **Weather Conditions:** Different weather patterns were observed, ranging from rain to clear skies.
---
## 👨💻 Steps Taken
- ✅ Created an OpenWeather account and generated an API key.
- ✅ Connected to the OpenWeather API using Python.
- ✅ Extracted real-time weather data.
- ✅ Transformed the data using Pandas.
- ✅ Loaded the processed data into a CSV file.
- ✅ Performed basic analysis to derive insights.
---
## 📂 Project Output
The project includes:
- 📓 ETL Pipeline Notebook
- 📄 Processed CSV Dataset
- 📘 README Documentation
---
## 📌 Skills Demonstrated
- API Integration
- ETL Pipeline Development
- Data Extraction
- Data Transformation
- Data Cleaning
- Data Analysis
- Data Storage using CSV
- Pyt …