inuwamobarak/N-ATLaS

N-ATLaS-LLM, a multilingual language model supporting African languages, is powered by Awarri Technologies as part of the Nigerian Languages AI Initiative. # N-ATLaS-LLM Demo This project demonstrates how to use the **N-ATLaS-LLM**, a multilingual large language model fine-tuned for African languages (Hausa, Igbo, Yoruba) alongside English. --- ## Features - Simple Python wrapper around Hugging Face's `transformers` library - Chat-style inference with role-based message formatting - Configurable generation parameters - Supports CUDA / auto device mapping --- ## Setup 1. Clone the repo: ```bash git clone github.com cd n_atlas_demo ``` ## HuggingFace Hub .gguf files huggingface.co ## Try with llama.cpp ```bash # Install python bindings pip install llama-cpp-python ``` ```bash # Use the model from llama_cpp import Llama llm = Llama( model_path="model_path/models/natlas/ggml-model-Q4_K_M.gguf", n_ctx=4096, # Context length n_threads=8, # Number of CPU threads ) response = llm( "What is the future of AI?", max_tokens=100, temperature=0.7, ) print(response['choices'][0]['text']) ```