chinyerelattea/Medisign

SignBridge Med: An AI-augmented health informatics platform bridging the communication gap between healthcare providers and the Deaf community in South Africa using MediaPipe gesture recognition and OpenAI Whisper. # Medisign SignBridge Med: An AI-augmented health informatics platform bridging the communication gap between healthcare providers and the Deaf community in South Africa using MediaPipe gesture recognition and OpenAI Whisper. # SignBridge Med: AI-Augmented Health Informatics **Bridging the Communication Gap in South African Public Healthcare** ## 🏥 Project Overview SignBridge Med is a technical solution designed to dismantle communication barriers for the over 600,000 Deaf citizens in South Africa. By aligning with SASL as the 11th official language, this platform provides a secure, touchless triage and consultation interface for public clinics. ### **The Problem** - Critical shortage of SASL interpreters in 4,000+ public clinics. - High risk of medical misdiagnosis due to language barriers. - Loss of patient privacy and dignity during triage. --- ## 🚀 Core Features - **Touchless Triage:** Initiated by a simple hand-wave using computer vision. - **QR-Code Passport:** Provides patients with a digital waitlist and visual hospital navigation. - **Two-Way Translation Bridge:** - **Doctor to Patient:** OpenAI Whisper converts speech into a signing avatar. - **Patient to Doctor:** MediaPipe tracks SASL signs and converts them to text/audio. - **Informatics Efficiency:** Automatically generates clinical reports, saving doctors ~15 minutes per consultation. --- ## 🛠️ Technical Stack The development of SignBridge Med utilized an AI-augmented engineering workflow: - **Language:** Python - **AI Pairing:** GitHub Copilot for logic optimization and debugging. - **Computer Vision:** Google MediaPipe for real-time hand-gesture and sign-language tracking. - **Speech Processing:** OpenAI Whisper for high-accuracy medical speech-to-text. - **Frontend/Deployment:** Streamlit for a lightweight, medical-grade interface. --- ## 📈 Roadmap (Phase 2) - **Haptic Alerts:** Integration of IoT vibration notifications for waiting room dignity. - **Voice-Triggered Start:** "Hi SignBridge" …