Logo Lanfrica
  • Home
  • Atlas
  • Insights
  • Docs
  • Sign in

© 2026 Lanfrica. All rights reserved. All copyrights of the resources shown on the Lanfrica website belong to the original copyright holders, unless explicitly stated otherwise.

InkubaLM: A small language model for low-resource African languages

Domain:

natural language processing

Record type:

papermodeldataset
Creator:
Tonja, Atnafu LambeboDosOjoRaj
Host:avatar
High-resource language models often fall short in the African context, where there is a critical need for models that are efficient, accessible, and locally relevant, even amidst significant computing and data constraints. This paper introduces InkubaLM, a small language model with 0.4 billion parameters, which achieves performance comparable to models with significantly larger parameter counts and more extensive training data on tasks such as machine translation, question-answering, AfriMMLU, and the AfriXnli task. Notably, InkubaLM outperforms many larger models in sentiment analysis and demonstrates remarkable consistency across multiple languages. This work represents a pivotal advancement in challenging the conventional paradigm that effective language models must rely on substantial resources. Our model and datasets are publicly available at huggingface.co to encourage research and development on low-resource languages.

Visit

arxiv.org

Tags

Computation and Language

Similar

Unsupervised Language Model Adaptation for Low-Resource LanguagesIs Small Language Model the Silver Bullet to Low-Resource Languages Machine Translation?Insights into Low-Resource Language Modelling: Improving Model Performances for South African LanguagesSMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource LanguagesA Transformer-Based Language Model for Sentiment Classification and Cross-Linguistic Generalization: Empowering Low-Resource African LanguagesEnhancing Sentiment Analysis in Amharic: Leveraging Transformer-Based Language Model for Low-Resource African Languages

Unsupervised Language Model Adaptation for Low-Resource Languages

This paper introduces a two-way neural machine translation system from Bengali to English and vice v

Is Small Language Model the Silver Bullet to Low-Resource Languages Machine Translation?

Low-resource languages (LRLs) lack sufficient linguistic resources and are underrepresented in bench

Insights into Low-Resource Language Modelling: Improving Model Performances for South African Languages

To address the gap in natural language processing for Southern African languages, our paper presents

SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages

In recent years, multilingual machine translation models have achieved promising performance on low-resource language pairs by sharing information between similar languages, thus enabling zero-shot translation. To overcome the "curse of multilinguality", these mode

A Transformer-Based Language Model for Sentiment Classification and Cross-Linguistic Generalization: Empowering Low-Resource African Languages

Enhancing Sentiment Analysis in Amharic: Leveraging Transformer-Based Language Model for Low-Resource African Languages