Amharic Catholic AI
# Amharic Catholic AI πͺπΉ
**User-Friendly Dataset Collector for Ethiopian Catholic Content**
A comprehensive, interactive AI system for processing Amharic Catholic texts, generating Q&A pairs, and creating training datasets for language models focused on Ethiopian Catholic content. Features a **user-friendly interface** that guides you through the entire process step-by-step!
## π Project Structure
```
amharic-catholic-ai/
βββ π launch.py # Simple launcher interface
βββ π― collect_dataset.py # Main interactive collector
βββ π CLAUDE.md # Detailed documentation
βββ βοΈ config.py # Configuration & API keys
βββ π¦ requirements.txt # Python dependencies
βββ data/
β βββ raw/ # π Source documents (PDFs, images)
β βββ processed/ # π Extracted text files
β βββ final/ # π― Training-ready Q&A datasets
β βββ validation_results/ # π Quality reports & analysis
βββ scripts/
β βββ enhanced_scraper.py # π Advanced web scraping
β βββ enhanced_ocr.py # π DeepSeek OCR processor
β βββ data_validator.py # β
Quality validation system
β βββ dashboard.py # π Progress monitoring
β βββ qa_generator.py # β Q&A pair generation
β βββ pdf_processor.py # π PDF text extraction
β βββ run_pipeline.py # π Automated pipeline
β βββ utils.py # π§ Helper utilities
βββ fine_tuning/
β βββ enhanced_fine_tuning.py # π§ Model training script
βββ logs/ # π Processing logs & sessions
```
### π― **Main Entry Points**
| File | Purpose | Best For |
|------|---------|----------|
| `launch.py` | Simple launcher menu | First-time users |
| `collect_dataset.py` | Full interactive interface | Regular use |
| `scripts/enhanced_*.py` | Individual components | Advanced users |
| `scripts/run_pipeline.py` | Automated processing | Batch jobs β¦