My first data engineering project - South African fuel price analysis
---
## Tools Used
| Tool | Purpose |
|------|---------|
| Python | Programming language |
| Pandas | Data manipulation and cleaning |
| SQLite | Lightweight database |
| Matplotlib | Data visualization |
| Jupyter Notebook | Interactive development |
---
## How to Run
1. Clone this repository
2. Open `01_extract.ipynb` or `02_clean_messy_data.ipynb` in VS Code or Jupyter
3. Run cells sequentially
---
## What I Learned
- Building ETL pipelines end-to-end
- Data inspection and quality checks
- Handling missing values (drop, fill with mean)
- SQL querying and aggregation
- Pipeline verification (no duplicates, correct counts, outlier detection)
- Time series visualization
- Git version control
---
## About Me
Software Developer currently completing my NQF6 Software Engineering qualification at WeThinkCode_, with a Data Engineering elective. I enjoy building software, solving real-world problems, and continuously learning new technologies. Passionate about using technology to create impact in communities like the one I come from. I also serve as a facilitator for the Digital Inclusion Programme, recruiting and introducing young people to opportunities in the Tech industry.