omar-rr/egypt-llm-finetune

--- base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0 library_name: peft pipeline_tag: text-generation license: apache-2.0 language: - en - ar tags: - base_model:adapter:TinyLlama/TinyLlama-1.1B-Chat-v1.0 - fine-tuned - text-generation - tinyllama - peft - lora - sft - transformers - trl - egypt - cs - ai-education --- # 🇪🇬 Egypt LLM Fine-Tune **Model ID:** `quantumsquatan/egypt-llm-finetune` This is an educational LoRA fine-tune of TinyLlama created while learning from the Hugging Face LLM Course in Egypt. It is designed for simple Computer Science, AI, programming, and student-life explanations in English with Egyptian Arabic context. ## Model Details ### Model Description - **Developed by:** quantumsquatan - **Shared by:** quantumsquatan - **Model type:** PEFT LoRA adapter for causal language modeling - **Base model:** `TinyLlama/TinyLlama-1.1B-Chat-v1.0` - **Language(s):** English and Arabic/Egyptian Arabic context - **License:** Apache 2.0 - **Fine-tuning method:** Supervised fine-tuning (SFT) with LoRA - **PEFT type:** LoRA - **LoRA rank:** 16 - **LoRA alpha:** 32 - **LoRA dropout:** 0.05 - **Target modules:** `q_proj`, `v_proj` - **Task type:** `CAUSAL_LM` - **Tokenizer max length:** 2048 - **Adapter size:** about 4.5 MB - **Funding:** No external funding reported ### Model Sources - **Hugging Face model:** quantumsquatan/egypt-llm-finetune - **GitHub repository:** omar-rr/egypt-llm-finetune - **Base model:** TinyLlama/TinyLlama-1.1B-Chat-v1.0 - **Paper:** No paper published for this educational fine-tune - **Demo:** No dedicated demo published yet ## Uses ### Direct Use This model can be used as a lightweight educational chat model for: - Explaining Computer Science concepts in simple language - Explaining basic AI and machine learning ideas - Helping students understand programming and technical study topics - Casual English/Arabic conversation with Egyptian student context - Demonstrating how LoRA fine-tuning works on a small model ### Downstream …