mzee2025/somalia-dashboard

# 🇸🇴 Somalia Data Collection Quality Dashboard A comprehensive data quality monitoring system for field data collection in Somalia. This dashboard extracts data from ONA (Open Data Kit), performs extensive quality checks, and generates interactive visualizations to monitor data collection in real-time. ## 🎯 Features ### Data Quality Checks - ✅ **Duplicate Detection**: Identifies duplicate submissions based on key fields - ⏱️ **Duration Monitoring**: Flags interviews shorter than 50 minutes or longer than 120 minutes - 📝 **Missing Values Analysis**: Tracks missing values by enumerator and field - ❌ **Incomplete Submissions**: Identifies and reports incomplete records - 📊 **Daily Trends**: Monitors submission patterns over time - 🗺️ **District Analysis**: Completion rates and statistics by district ### Visualizations - 📈 Interactive daily submission trends with moving averages - 🏆 District-wise completion rate comparisons - ⏰ Interview duration distribution histograms - 👥 Enumerator performance scorecards - 🥧 Quality issues breakdown - 🔥 Missing values heatmap by enumerator and field ### Reports - 🎯 Real-time quality score calculation - 📋 Detailed tables for all issues - 👤 Enumerator-specific performance metrics - 🚨 Flagged records with enumerator attribution ## 📁 Project Structure ``` somalia_dashboard/ ├── main.py # Main application entry point ├── config.py # Configuration and settings ├── ona_extractor.py # ONA API data extraction ├── quality_checker.py # Data quality checking logic ├── visualizer.py # Dashboard visualization generation ├── requirements.txt # Python dependencies ├── README.md # This file └── reports/ # Generated dashboard reports (created automatically) ``` ## 🚀 Quick Start ### 1. Install Dependencies ```bash pip install -r requirements.txt ``` Required packages: - pandas >= 1.3.0 - numpy >= 1.20.0 - plotly >= 5.0.0 - requests >= 2.25.0 - python-dateutil >= 2 …