A real-time system that translates Kenyan Sign Language (KSL) gestures to speech and converts speech to animated KSL signs using 3D hand models. Enables bidirectional communication between signers and non-signers, supporting accessibility and interactive learning.
---
title: KSL Sign Language Translator
emoji: 🤟
colorFrom: green
colorTo: blue
sdk: docker
app_port: 7860
pinned: false
---
# KSL Sign Language Translator
Real-time sign language translation using MediaPipe and TensorFlow Lite.
## Model Files Required
Place these files in your Space:
- `kls_model_lite.tflite` - Your trained sign language model
- `hand_landmarker.task` - MediaPipe hand landmark model
---
```markdown
# 🤟 KSL Sign Language Translator
Real-time sign language translation application that converts Kenyan Sign Language (KSL) gestures into spoken words using computer vision and machine learning.
## 🌟 Features
- **Real-time Sign Recognition** - Instant translation of sign language gestures
- **Colorful Hand Landmarks** - Visual feedback with color-coded finger tracking
- **Immediate Audio Feedback** - Each recognized sign is spoken aloud immediately
- **Live Video Processing** - Works with your webcam in real-time
- **User-Friendly Interface** - Simple Gradio web interface
## 🎯 Live Demo
Try it live on Hugging Face Spaces: [(
huggingface.co)]
## 📋 Table of Contents
- How It Works
- Installation
- Usage
- Project Structure
- Model Details
- Technical Stack
- Troubleshooting
- License
## 🔍 How It Works
1. **Hand Detection** - MediaPipe detects hand landmarks in real-time
2. **Feature Extraction** - 126 features (63 per hand) extracted from hand positions
3. **Sequence Processing** - Features buffered over 40 frames
4. **Sign Classification** - TensorFlow Lite model predicts the sign
5. **Speech Output** - Recognized signs spoken using text-to-speech
### Visual Guide
- **White Circle** - Palm center
- **Red Thumb** - Thumb tracking
- **Blue Index Finger** - Index finger tracking
- **Green Middle Finger** - Middle finger tracking
- **Yellow Ring Finger** - Ring finger tracking
- **Magenta Pinky** - Pinky finger tracking
## Installation
### Local Development
1. Clone the repository
```bash
git clone http …