Logo Lanfrica

KASSIMI-Achraf/MeknesHeritage

Domaine:

natural language processing

Type de record:

software
Créateur:
KAS
HĂ´te:
🕌 AR tourist guide for Meknes, Morocco — an AI-powered virtual avatar that speaks, listens, and shares the history of Moroccan landmarks in real-time using LLMs, Whisper STT, and neural TTS. Built with Unity 6 & AR Foundation. # 🕌 Meknes Heritage — AR Tourist Guide **An immersive Augmented Reality experience that brings the cultural heritage of Meknes, Morocco to life through an AI-powered virtual tourist guide.** This project is a Mixed Reality application built with **Unity 6** and **AR Foundation** that places an interactive 3D avatar — a friendly local guide named **Amine** — into the user's real-world environment. Visitors can have natural spoken conversations with Amine about the historic landmarks, architecture, and culture of Meknes, one of Morocco's four Imperial Cities and a UNESCO World Heritage site. The guide responds intelligently using a **dual-LLM architecture** (cloud + local fallback), understands voice input through **speech-to-text**, and speaks back with natural neural voices via **text-to-speech** — all while displaying contextual images of landmarks and surrounded by authentic Moroccan environment props like Zellige tilework and traditional fountains. --- ## 📸 Demo | 🧍 AR Avatar Guide (Amine) | 🏛️ Bab Mansour Landmark | 🏛️ Volubilis Landmark Popup | | :---: | :---: | :---: | | | | | --- ## ✨ Features | Feature | Description | |---------|-------------| | 🧍 **AR Avatar Placement** | Tap any real-world surface to spawn the 3D guide avatar using AR plane detection | | 🧠 **Dual-LLM Intelligence** | Groq cloud API (ultra-fast, llama-3.3-70b) with automatic Ollama local fallback | | 🎙️ **Voice Conversation** | Full speech-to-text via Groq Whisper — talk naturally to the guide | | 🔊 **Neural Text-to-Speech** | Responses spoken aloud using Microsoft Edge TTS (free, high-quality neural voices) | | 🌍 **Multi-Language** | Supports English, French, and Arabic — switch languages on the fly | | 🏛️ **Landmark Recognition** | Contextual image popups for landmarks: Bab Mansour, Heri Es-Souani, Volubilis, and more | | 👄 **Audio Lip Sync** | Real-time lip sync driven by TTS audio for lifelike avatar speech | | 🕌 **Moroccan Environment** | Decorative Zellige floor, tradit …