jilali-elhamidi/realtime-multilingual-voice-agent-assurance

📞 Smart Insurance Voice Agent: Multilingual (Darija/Fr) & agentic. Uses LiveKit & Gemini for zero-latency reasoning. Features CRM-based personalization, RAG for claims resolution, and an AI Supervisor for secure handover. 🏆 Capgemini Hackathon Project. # 📞 Realtime Multilingual Voice Agent — Assurance *The Smart Insurance Voice AI* > **"Make it real."** — Capgemini GenAI Hackathon 2026 --- ## 📖 About The Project **OurCallbot** is a **real-time, agentic voice AI** designed to **revolutionize insurance customer support**. Unlike traditional IVRs, it **listens, reasons, and acts**, bridging the language gap with **Darija/French** support. This project was built for the **Capgemini GenAI & Agentic AI Hackathon**, addressing high-volume repetitive claims while improving personalization and efficiency. --- ## 🚀 Key Features (The 4 Super-Powers) ### 1️⃣ ⚡ Instantaneity (Zero Latency) - Built on **LiveKit** (Go infra) for **real-time WebRTC streaming** - Response time < 200ms — **no awkward pauses** ### 2️⃣ 🧠 Absolute Knowledge (RAG) - Connected to **ChromaDB** vector database for **accurate, context-aware answers** - Avoids hallucinations and retrieves **specific clauses** about claims, delays, and coverage ### 3️⃣ 🎭 Hyper-Personalization (Smart CRM) - Instantly identifies the user via **CIN / phone number** - **Dynamic Psychology:** adapts tone per profile (*Direct* for VIPs, *Formal* for High-Risk users) - Supports **2FA security verification** via email simulation ### 4️⃣ 🛡️ The Invisible Supervisor - **Secondary AI model** monitors the conversation in real-time - **Crisis Detection:** triggers human handover if anger or legal threats detected, with **full context summary** ### 5️⃣ 🌍 Production-Ready Integration (SIP/Twilio) - **Universal Connectivity:** Thanks to LiveKit, the agent natively supports **SIP Trunks and Twilio**. - **Plug & Play:** It can be deployed on a real phone number immediately. - **Enterprise Webhooks:** Easily integrates with external CRMs (Salesforce, HubSpot) or ticketing tools via standard JSON webhooks. --- ## 🏗️ Technical Architecture | Component | Technology | Description | |-----------|------------|-------------| | **Core Logic** | Python 3.10+ | Main application logic …