GUUTA/qubee-nlp

Qubee NLP: Natural Language Processing for Afaan Oromoo ```markdown # Qubee NLP **Natural Language Processing tools for Afaan Oromoo (Oromo language) using Qubee script** Installation • Quick Start • Documentation • Examples ## Features - **Text Validation**: Validate Qubee script text for Afaan Oromoo - **Tokenization**: Word and sentence tokenization with context awareness - **Normalization**: Text cleaning, diacritic handling, and standardization - **Stemming**: Morphological analysis and stemming for Afaan Oromoo - **POS Tagging**: Part-of-speech tagging framework - **Syllabification**: Syllable segmentation based on Oromo phonotactics - **Stopword Removal**: Language-specific stopword lists - **Corpus Tools**: Corpus building, processing, and analysis ## Installation ### From PyPI (Recommended) ```bash pip install qubee-nlp ``` ### From Source ```bash git clone github.com cd qubee-nlp pip install -e . ``` ### For Development ```bash git clone github.com cd qubee-nlp pip install -e .[dev] # Includes testing and development tools ``` ## Quick Start ```python from qubee_nlp import word_tokenize, sentence_tokenize # Tokenize text text = "Afaan Oromoo afaan guddaa dha." tokens = word_tokenize(text) print(tokens) # ['AFAAN', 'OROMOO', 'AFAAN', 'GUDDAA', 'DHA'] # Tokenize sentences sentences = sentence_tokenize("Kuni kitaaba dha. Inni bareessaa dha.") print(sentences) # ['KUNI KITAABA DHA.', 'INNI BAREESSAA DHA.'] ``` ### Text Validation ```python from qubee_nlp import validate_qubee_text is_valid, invalid_chars = validate_qubee_text("Afaan Oromoo") print(is_valid) # True print(invalid_chars) # [] ``` ### Text Normalization ```python from qubee_nlp import normalize_qubee text = " Áfáan Oromoo " normalized = normalize_qubee(text) print(normalized) # "AFAAN OROMOO" ``` ### Advanced Tokenization ```python from qubee_nlp import QubeeTokenizer tokenizer = QubeeTokenizer(preserve_case=True) tokens = tokenizer.tokenize("Afaan Oro …