abdelazizharane/KalamAI

A video conferencing platform with real-time audio translation powered by Claude Opus 4.7, designed for African and international institutions. # KalamAI - Visioconference platform for low-ressource languages A video conferencing platform with real-time audio translation powered by Claude Opus 4.7, designed for African and international institutions. ## 🚀 Quick Start ```bash # 1. Clone the repo git clone github.com cd kalamAI # 2. Environment variables cp .env.example .env echo “ANTHROPIC_API_KEY=sk-ant-...” >> .env # 3. Start everything docker compose up --build ``` Frontend: localhost API: localhost API Docs: localhost ## 🧠 Architecture ``` French speech → faster-whisper (STT) → Claude Opus 4.7 (translation) → CosyVoice3-0.5B (TTS 150ms) — FR/EN/ES/DE/IT/RU → Fish Speech V1.5 (TTS ~200ms) — AR/HA/SW + 77 others ``` ### 4 Claude Opus 4.7 Agents | Agent | Role | Frequency | |---|---|---| | **Translation** | Translates each segment in real time | Continuous | | **Summary** | Structured summary of the meeting | Every 5 min | | **Action Items** | Extracts decisions and commitments | Every 2 min | | **Email** | Drafts the post-meeting follow-up | End of meeting | ### Supported Languages | Language | ASR (speech-to-text) | TTS (text-to-speech) | |---|---|---| | French | ✅ Whisper | ✅ CosyVoice3 (150ms) | | English | ✅ Whisper | ✅ CosyVoice3 (150ms) | | Standard Arabic | ✅ Whisper | ✅ Fish Speech (~200ms) | | Spanish | ✅ Whisper | ✅ CosyVoice3 (150ms) | | Hausa | ⚠️ Partial Whisper | ✅ Fish Speech | | Swahili | ⚠️ Partial Whisper | ✅ Fish Speech | | **Chadian Arabic (Shu)** | ⚠️ Via Standard Arabic | 🔶 Fish Speech + glossary | | **Sara (Ngambay)** | 🔶 Auto-detection | 🔶 Fish Speech + glossary | ## 📁 Structure ``` kalamAI/ ├── backend/ │ ├── main.py # FastAPI app │ ├── services/ │ │ ├── stt_service.py # faster-whisper │ │ ├── tts_service.py # CosyVoice3 + Fish Speech │ │ └── translation_service.py # Claude Opus 4.7 │ ├── agents/ │ │ └── meeting_agents.py # 4 Cl …