mahdimessai/KhedmAlytic

A job scraper and analysis project for the Tunisian market # KhedmAlytic This project is designed for web scraping and data analysis, specifically for the tunisian job market. It is deployed using Streamlit for interactive data visualization. ## Folder Structure - ** APIs **: API interaction scripts. - ** geo_api.py **: Geolocation API integration. - ** industry_classification.py **: Industry classification logic using Llama3 API. - ** config **: Configuration settings for scrapers. - ** data **: Directory for storing raw data files. - ** database **: Database interaction scripts. - ** database.py **: Wrapper around motor (MongoDB). - ** scrapers **: Web scraping scripts. - ** BaseScraper.py **: Base scraper class with common functionalities. - ** BaytScraper.py **: Specific scraper for Bayt.com. - ** TanitScraper.py **: Specific scraper for TanitJobs. - ** streamlit_app **: Streamlit app components for the web interface. - ** introduction.py **: Introductory page of the Streamlit app. - ** processing.py **: Data processing scripts for the app. - ** visualization.py **: Data visualization components for the app. - ** utils **: Utility functions. - ** utils.py **: Helper functions used across the project. - ** .env **: Environment variables file. - ** app.py **: Streamlit application script for running the project. - ** scrape.py **: Script to initiate the web scraping process.