AI-Institute-Africa/omnis-signal

intelligence data fetcher # Zimbabwe Telecom Market Intelligence Scraper A comprehensive Python-based scraper for collecting telecom market intelligence from Zimbabwe's major telecommunications operators and ISPs. ## 📊 Overview This scraper systematically collects, normalizes, and exports pricing, bundles, tariffs, and service data from Zimbabwe's telecom providers including: - **Econet Wireless Zimbabwe** (MNO) - **NetOne Cellular** (MNO) - **Telecel Zimbabwe** (MNO) - **TelOne** (Fixed Telecom/ISP) - **Tagtel** (MVNO) - **Liquid Home Zimbabwe** (Fibre ISP) - **Africom** (Enterprise ISP) - **ZOL Zimbabwe** (ISP) - **Dandemutande** (ISP) - **Utande** (Data Centre/ISP) ## 📦 What's Included ### Files 1. **advanced_telecom_scraper.py** - Main scraper with complete provider coverage 2. **telecom_scraper.py** - Basic scraper template 3. **SCHEMA.md** - Complete data schema documentation 4. **requirements.txt** - Python dependencies 5. **README.md** - This file ### Generated Outputs - **zimbabwe_telecom_intelligence.csv** - CSV format (Excel-compatible) - **zimbabwe_telecom_intelligence.json** - JSON format (API-ready) - **zimbabwe_telecom_intelligence.xlsx** - Excel spreadsheet with formatting ## 🚀 Quick Start ### Installation ```bash pip install -r requirements.txt ``` ### Run the Scraper ```bash python advanced_telecom_scraper.py ``` This will: 1. Collect data from all configured providers 2. Normalize prices (USD and local currency) 3. Export to CSV, JSON, and Excel formats 4. Display collection summary ## 📋 Data Schema The scraper collects 44 fields per service offering: ### Core Fields - `provider_name` - Telecom company name - `provider_type` - MNO, ISP, MVNO, etc. - `service_category` - voice_bundle, data_bundle, broadband_plan, etc. - `service_name` - Product/bundle name - `unit_type` - GB, MB, Minutes, SMS Count, Mbps, etc. - `price_usd` - Normalized USD price - `price_local` - Local currency price (ZWG, ZWD, etc.) - `billing_period` - Daily, Weekly, Monthly, etc. - `va …