youssefehab241/egypt-tech-salary-predictor

# Egypt Tech Salary Predictor A Big Data / Machine Learning project that predicts expected monthly salaries for tech jobs in Egypt using real-world job market data collected from multiple sources and prepared through a complete data pipeline. --- ## Project Overview This project started with scraping job postings from Wuzzuf to explore the Egyptian tech job market, then evolved into a full salary prediction system based on: - cleaned and merged salary datasets - standardized tech job categories - years of experience - location grouping - work mode - seniority level The final system provides an interactive Streamlit dashboard where the user selects a tech position and job-related attributes, then receives an estimated monthly salary in EGP. --- ## Main Objectives - Collect real tech job data from the Egyptian market - Clean and normalize salary and job information - Standardize job titles into a limited set of tech categories - Build intermediate datasets for training and dashboard usage - Train machine learning models for salary prediction - Deploy the final model using Streamlit --- ## Final Job Categories The final project standardizes jobs into the following categories: - back end engineer - front end engineer - full stack engineer - data/ai engineer - software testing engineer - mobile engineer - devops engineer - embedded engineer - technical support engineer - cybersecurity engineer - ui/ux designer --- ## Final Dashboard Inputs The final optimized dashboard uses: - `job_title_clean` - `experience_years_clean` - `location_clean` (simplified in the dashboard for usability) - `work_mode_clean` - `level_clean` Target: - `salary_target` --- ## Data Pipeline The project includes multiple stages of data preparation. ### 1. Wuzzuf Scraping Pipeline Inside `wuzzuf_scraping_pipeline/`: - `scrape.py` Scrapes job postings from Wuzzuf using Selenium. - `data_cleaning.py` Cleans salary and experience fields and prepares structured data. - `model_ …