Bithal98/OdiaLLM-Transformer-from-Scratch

Odia-English Transformer model (90M params) trained from scratch on 500K sentence pairs for low-resource NLP # OdiaLLM – Transformer from Scratch. A 90M parameter Encoder-Decoder Transformer trained from scratch for Odia-English translation. ## 🚀 Features - Built using "Attention Is All You Need" - Trained on ~500K parallel sentences - No pretrained models used - Optimized for low-resource language (Odia) ## 📊 Results - chrF Score: 36.45 ## 🧠 Tech Stack - Python - PyTorch - NLP - Transformers ## 📁 Files - Training Notebook - Data Processing - Evaluation ## 🔗 Author Bithal Kumar Sahoo