Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

Khayo-7/Kira-Solutions-Ethiopian-Medical-Businesses-Data-Warehouse-W7

Domaine:

healthcare
Créateur:
Kha
Hôte:
# 10Academy-Kifiya-Week-7 # Building a Scalable Data Pipeline for Ethiopian Medical Businesses: ## Introduction In the rapidly evolving landscape of Ethiopian e-commerce, structured and accessible data is a key enabler for informed decision-making. At **Kara Solutions**, embarking on a mission to build a **comprehensive data warehouse** for Ethiopian medical businesses by leveraging data scraped from **Telegram channels**, the approach focuses on creating a **scalable, modular, and efficient pipeline**, ensuring seamless data collection, transformation, and analysis. --- ## Task 1: Data Scraping from Telegram ### **Objective:** The goal of this task was to **collect raw data from Telegram channels** where medical businesses actively post their products, services, and contact details. Given the decentralized nature of business listings in Ethiopia, Telegram serves as a crucial data source. ### **Approach:** A **scalable Telegram scraper** was developed using **Telethon**, an asynchronous Python library for interacting with the Telegram API. The scraper extracts messages from targeted channels, including: - **Business Listings** (clinic and pharmacy details, supplier information) - **Product Advertisements** (medications, equipment, medical supplies) - **Contact Information** (phone numbers, addresses, website links) - **Media Attachments** (images, PDFs, and videos related to the listings) ### **Key Features Implemented:** ✅ **Asynchronous scraping** for high efficiency and reduced API rate limitations ✅ **Storage in MongoDB**, ensuring structured collection and retrieval ✅ **Metadata extraction**, including timestamps, message IDs, and sender details ✅ **Handling media files**, downloading and storing paths for images and videos ✅ **Filtering relevant messages** based on keywords and patterns ### **Challenges Faced & Solutions:** **1. API Rate Limits:** implemented adaptive request throttling to avoid Telegram restrictions. **2. Unstructured Data:** Message …

Visit

github.com

Languages

AmharicOlukhayo

Similaires

jonnahjr/ethiopian-medical-business-data-warehouse-W7Heban-7/Ethiopian-Medical-Data-WarehouseEthel-Star/Week-7.Ethiopian-medical-business-Data-WarehouseKhayo-7/MoonLight-Energy-Solutions-Solar-Data-Analysis-W0kaleabb266/ethiopian-medical-data-warehouseGemechu90/ethiopian-medical-data-warehouse

jonnahjr/ethiopian-medical-business-data-warehouse-W7

EthioMedDataWarehouse A comprehensive data pipeline and warehouse solution for collecting, processin

Heban-7/Ethiopian-Medical-Data-Warehouse

A comprehensive data warehouse solution for Ethiopian medical business data; integrating Telegram sc

Ethel-Star/Week-7.Ethiopian-medical-business-Data-Warehouse

As a data engineer at Kara Solutions, I am building a data warehouse for Ethiopian medical business

Khayo-7/MoonLight-Energy-Solutions-Solar-Data-Analysis-W0

# 10Academy-Kifiya-Week-0 # Report: Strategic Analysis of Solar Farm Data for MoonLight Energy Solu

kaleabb266/ethiopian-medical-data-warehouse

# **Ethiopian Medical Data Warehouse** ## **Project Overview** This project is a **data warehouse*

Gemechu90/ethiopian-medical-data-warehouse

This project builds a comprehensive data warehouse for Ethiopian medical business data scraped from