Logo Lanfrica

MaSk887/Dubizzle-RealEstate-Automation-Pro

Domaine:

socioeconomic

Type de record:

software
Créateur:
MaS
Hôte:
High-performance Python Scraper for Dubizzle Egypt. Automatically identifies 'Private User' listings, calculates price per meter, and exports clean, duplicate-free data to Excel. Designed for real estate investors and data analysts. --- # 🏠 Real Estate Scraper (Owner Finder V11 - Pro Edition) An advanced, multi-threaded logic automation tool designed to dominate the **Dubizzle Egypt (formerly OLX)** real estate market. This Pro version doesn't just find ads; it deep-scans listings to identify **direct owners** and calculates key investment metrics automatically. --- ## 🚀 Pro Features & Enhancements ### 1. **Advanced Data Extraction** The scraper now extracts detailed property specifications directly from the listing cards: * **Bedrooms & Bathrooms**: Automatically parses "غرف" and "حمام". * **Property Area**: Captures the exact "مساحة" in square meters. * **Smart Calculation**: Automatically calculates the **Price per Meter (سعر المتر)** to help you identify the best deals. ### 2. **Deep Owner Verification Logic** The script goes beyond the surface. It visits each individual ad URL and performs a full-text scan for the "Private User" (**مستخدم خاص**) tag, effectively filtering out brokers, offices, and companies. ### 3. **Intelligent Freshness Filter** Using a custom Arabic date interpreter in `Help_Fun.py`, the script converts relative dates (e.g., "منذ ساعة", "أمس") into logical data. It only processes ads within your defined `MAX_DAYS` window to save time and resources. ### 4. **Elite Anti-Ban System** * **Cloudscraper Integration**: Bypasses modern bot detection mechanisms. * **Dynamic Header Rotation**: Uses a diversified `HEADERS_LIST` with different browsers (Chrome, Firefox, Edge) and platforms (Windows, Mac, Linux) to avoid footprinting. * **Safety Delays**: Implements `safe_delay()` with randomized intervals to mimic natural human browsing patterns. --- ## 🛠️ Technical Architecture * **`main_scr.py`**: The central controller. Orchestrates the scraping flow and sorts results by **Price per Meter** before saving. * **`Pre.py`**: The engine's heart. Contains the global settings, comprehensive area dictionary (Slugs), and the rotating header pool. * **`SCR_Fun.py`**: The h …