Logo Lanfrica

AstroXcode/tunisian-speech-darija-tts

Domain:

natural language processing

Record type:

software
Creator:
Ast
Host:
Authentic Tunisian Darija speech recognition and text-to-speech system with Billy personality mode # NOVA OS ๐Ÿ”ฎ > Your personal Jarvis-style AI voice assistant. Runs 100% locally. No cloud. No subscriptions. ## Features - ๐ŸŽ™๏ธ **Voice control** โ€” Press `Ctrl+Space` to wake NOVA - ๐Ÿง  **Custom LLM** โ€” Fine-tuned Phi-3.5 Mini, served by Ollama locally - ๐Ÿ”Š **Fish Audio TTS** โ€” Your local Fish Speech server - ๐ŸŒ **Browser control** โ€” "Search forโ€ฆ" / "Go to YouTube" - ๐Ÿ“ฑ **App launching** โ€” "Open Chrome", "Launch Spotify", etc. - ๐Ÿ‘๏ธ **Screen vision** โ€” "What's on my screen?" uses LLaVA locally - โœจ **Particle sphere** โ€” Three.js animated sphere reacts to voice - ๐Ÿ’ฅ **Antigravity burst** โ€” Particle explosion on every spoken sentence --- ## Setup ### 1. Prerequisites | Requirement | Install | |---|---| | Node.js 18+ | nodejs.org | | Python 3.10+ | python.org | | Ollama | ollama.ai | | Fish Speech | Already installed | ### 2. Install dependencies ```bash cd nova-os npm install ``` ### 3. Pull Ollama vision model (for screen awareness) ```bash ollama pull llava ``` ### 4. Train & register the NOVA model > Skip this if you want to use a pre-existing Ollama model. > Set `OLLAMA_MODEL=llama3.2` in `.env` and jump to step 5. ```bash # Install Python training deps pip install unsloth trl transformers datasets torch # Run fine-tuning (~30-60 min on RTX 3050) python training/train.py # Register the model in Ollama ollama create nova -f training/Modelfile # Test it ollama run nova "Hey, who are you?" ``` ### 5. Start Fish Speech server Make sure your Fish Speech local server is running on port 8888: ```bash # In your fish-speech directory: python tools/api_server.py --listen 0.0.0.0:8888 ``` ### 6. Launch NOVA OS ```bash npm run dev ``` --- ## Usage | Action | How | |---|---| | Wake NOVA | `Ctrl+Space` or click ๐ŸŽ™ | | Open an app | "Open Chrome" / "Launch Discord" | | Search web | "Search for Python tutorials" | | Go to URL | "Open YouTube" / "Go to Reddit" | | See screen | "What's on my screen?" | | Chat | Type in the chat box or sp โ€ฆ