Rule-based lemmatizer for Hausa
# Hausa NLP Toolkit
A simple Python toolkit for Hausa language text processing with POS tagging and lemmatization. This toolkit was created to prepare Hausa texts for the process of creating embeddings.
## What's Inside
Two main classes for Hausa text processing:
HausaPOSTagger - adds part-of-speech tags to Hausa text
HausaLemmatizer - finds base forms of words (lemmas)
## Model Attribution
This project uses the `masakhane/hausa-pos-tagger-afroxlmr` model from the Masakhane project for POS tagging. The model is based on AfroXLMR and was trained on Hausa text data.
## Dependencies
- transformers
- torch
- pandas