Njihia097/Educational-Dubbing-Pipeline-for-En-Sw

End-to-end multilingual educational video dubbing pipeline enabling ASR, MT, TTS, and automated Swahili localization # Educational Dubbing Pipeline **An MVP system for multilingual video dubbing, specializing in English → Kenyan Swahili translation for educational content.** ## 📋 Table of Contents - Overview - Features - Architecture - Tech Stack - Prerequisites - Installation & Setup - Configuration - Usage - API Documentation - Development - Project Structure - Pipeline Process - Troubleshooting - Contributing --- ## 🎯 Overview The Educational Dubbing Pipeline is a full-stack application that automates the process of dubbing educational videos from English to Kenyan Swahili. It uses machine learning models for Automatic Speech Recognition (ASR), Machine Translation (MT), and Text-to-Speech (TTS) synthesis, combined with audio processing for music separation and video mixing. The system consists of: - **Backend API**: Flask-based REST API with Celery task queue - **Frontend**: React-based dashboard for job management and monitoring - **External AI Service**: Separate microservice handling ML model inference - **Storage**: MinIO (S3-compatible) object storage - **Database**: PostgreSQL for metadata and job tracking --- ## ✨ Features ### For Content Creators - 📤 **Video Upload**: Drag-and-drop interface for video file uploads - 📊 **Job Dashboard**: View all dubbing jobs with real-time status updates - 📝 **Transcript Viewer**: View and edit English and Swahili transcripts with timestamps - 🎬 **Video Preview**: Preview dubbed videos with synchronized transcript segments - 📥 **Download Manager**: Download final dubbed videos and intermediate outputs - 🔄 **Translation Feedback**: Submit corrections and feedback on translation quality ### For Administrators - 📈 **Analytics Dashboard**: System-wide metrics and performance monitoring - 👥 **User Management**: Monitor all users and their job activity - 📊 **Pipeline Metrics**: Track ASR, MT, and TTS performance metrics - 📉 **Model Metrics**: Monitor model performance across jobs - 🔍 **MT Quality Analytics**: Analyze translation fe …