Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

SambaLingo: Teaching Large Language Models New Languages

Domaine:

natural language processing

Type de record:

papermodel
Créateur:
CsaLi, BoLi,Xu,
Hôte:avatar
Despite the widespread availability of LLMs, there remains a substantial gap in their capabilities and availability across diverse languages. One approach to address these issues has been to take an existing pre-trained LLM and continue to train it on new languages. While prior works have experimented with language adaptation, many questions around best practices and methodology have not been covered. In this paper, we present a comprehensive investigation into the adaptation of LLMs to new languages. Our study covers the key components in this process, including vocabulary extension, direct preference optimization and the data scarcity problem for human alignment in low-resource languages. We scale these experiments across 9 languages and 2 parameter scales (7B and 70B). We compare our models against Llama 2, Aya-101, XGLM, BLOOM and existing language experts, outperforming all prior published baselines. Additionally, all evaluation code and checkpoints are made public to facilitate future research. 23 pages

Visit

arxiv.org

Tasks

language modelingtransfer learning

Tags

Computation and LanguageArtificial IntelligenceMachine Learning

Similaires

Uncovering inequalities in new knowledge learning by large language models across different languagesIrokoBench: A New Benchmark for African Languages in the Age of Large Language ModelsSunflower: A New Approach To Expanding Coverage of African Languages in Large Language ModelsMEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and TasksLugha-Llama: Adapting Large Language Models for African LanguagesStory Generation with Large Language Models for African Languages

Uncovering inequalities in new knowledge learning by large language models across different languages

As large language models (LLMs) gradually become integral tools for problem solving in daily life wo

IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models

Despite the widespread adoption of Large language models (LLMs), their remarkable capabilities remai

Sunflower: A New Approach To Expanding Coverage of African Languages in Large Language Models

There are more than 2000 living languages in Africa, most of which have been bypassed by advances in language technology. Current leading LLMs exhibit strong performance on a number of the most common languages (e.g. Swahili or Yoruba), but prioritise support fo

MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks

There has been a surge in LLM evaluation research to understand LLM capabilities and limitations. Ho

Lugha-Llama: Adapting Large Language Models for African Languages

Large language models (LLMs) have achieved impressive results in a wide range of natural language ap

Story Generation with Large Language Models for African Languages