Logo Lanfrica

Yosef-Ali/Amharic-Catholic-AI

Domain:

natural language processing

Record type:

softwareproject
Creator:
Yos
Host:
Amharic Catholic AI # Amharic Catholic AI πŸ‡ͺπŸ‡Ή **User-Friendly Dataset Collector for Ethiopian Catholic Content** A comprehensive, interactive AI system for processing Amharic Catholic texts, generating Q&A pairs, and creating training datasets for language models focused on Ethiopian Catholic content. Features a **user-friendly interface** that guides you through the entire process step-by-step! ## πŸ“ Project Structure ``` amharic-catholic-ai/ β”œβ”€β”€ πŸš€ launch.py # Simple launcher interface β”œβ”€β”€ 🎯 collect_dataset.py # Main interactive collector β”œβ”€β”€ πŸ“‹ CLAUDE.md # Detailed documentation β”œβ”€β”€ βš™οΈ config.py # Configuration & API keys β”œβ”€β”€ πŸ“¦ requirements.txt # Python dependencies β”œβ”€β”€ data/ β”‚ β”œβ”€β”€ raw/ # πŸ“„ Source documents (PDFs, images) β”‚ β”œβ”€β”€ processed/ # πŸ“ Extracted text files β”‚ β”œβ”€β”€ final/ # 🎯 Training-ready Q&A datasets β”‚ └── validation_results/ # πŸ“Š Quality reports & analysis β”œβ”€β”€ scripts/ β”‚ β”œβ”€β”€ enhanced_scraper.py # 🌐 Advanced web scraping β”‚ β”œβ”€β”€ enhanced_ocr.py # πŸ” DeepSeek OCR processor β”‚ β”œβ”€β”€ data_validator.py # βœ… Quality validation system β”‚ β”œβ”€β”€ dashboard.py # πŸ“Š Progress monitoring β”‚ β”œβ”€β”€ qa_generator.py # ❓ Q&A pair generation β”‚ β”œβ”€β”€ pdf_processor.py # πŸ“„ PDF text extraction β”‚ β”œβ”€β”€ run_pipeline.py # πŸ”„ Automated pipeline β”‚ └── utils.py # πŸ”§ Helper utilities β”œβ”€β”€ fine_tuning/ β”‚ └── enhanced_fine_tuning.py # 🧠 Model training script └── logs/ # πŸ“‹ Processing logs & sessions ``` ### 🎯 **Main Entry Points** | File | Purpose | Best For | |------|---------|----------| | `launch.py` | Simple launcher menu | First-time users | | `collect_dataset.py` | Full interactive interface | Regular use | | `scripts/enhanced_*.py` | Individual components | Advanced users | | `scripts/run_pipeline.py` | Automated processing | Batch jobs …

Languages