This repository mainly focusses the English to Xhosa Translation whit a SentencePiece + Bpe tokenizer and finetuning on medical data with LoRA. Also includes mechanistic interpretability of the model.
# English-to-Xhosa-translation
This repository mainly focusses the English to Xhosa Translation whit a SentencePiece + Bpe tokenizer and finetuning on medical data with LoRA. Also includes mechanistic interpretability of the model.
# Architecture
# Results
AVERAGE WORD ERROR RATE - 0.0000500
AVERAGE CHARACTER ERROR RATE - 0.0000295