MwangiJoseph-25/Kenya-Supermarket-Price-Comparison
Domaine:
socioeconomicCréateur:
Mwa
Hôte:
# Kenya Retail Price Comparison Platform
A complete end-to-end data extraction and comparison project that scrapes product prices from major Kenyan supermarkets and provides a dashboard for price comparison.
**Active Dashboard:** See prices from Quickmart, Naivas, and Eastmatt side-by-side and find the best deals!
---
## Project Overview
This project is an end-to-end solution for:
1. **Data Collection** - Web scrape product data from 3 major Kenyan supermarkets
2. **Data Processing** - Transform and clean data using Python/pandas
3. **Data Storage** - Store processed data in PostgreSQL database
4. **Web rendering** - Present data through an interactive Flask web dashboard
## Architecture
```
┌─────────────────────────────────────────────┐
│ Web Scraping Layer │
│ (Selenium + BeautifulSoup) │
│ - Quickmart, Naivas, Eastmatt │
└────────────────┬────────────────────────────┘
│
▼
┌─────────────────────────────────────────────┐
│ Data Processing Layer │
│ (Jupyter Notebook + Pandas) │
│ - Data loading to dataframes │
│ - Data transformation │
│ - Deduplication │
└────────────────┬────────────────────────────┘
│
▼
┌─────────────────────────────────────────────┐
│ Database Layer │
│ (PostgreSQL) │
│ - Persistent data storage │
│ - Indexing for fast queries |
| - Hosted on Aiven cloud |
└────────────────┬────────────────────────────┘
│
▼
┌─────────────────────────────────────────────┐
│ Web Application Layer │
│ (Flask +HTML +CSS + JavaScript) │
│ - REST API endpoints │
│ - Interactive dashboard │
│ - Real-time search │
└─────────────────────────────────────────────┘
```
---
## Technologies
### …