Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

NagaNLP: Bootstrapping NLP for Low-Resource Nagamese Creole with Human-in-the-Loop Synthetic Data

Domaine:

natural language processing

Type de record:

paperdatasetmodelsoftware
Créateur:
MaiPanMan
Hôte:avatar
The vast majority of the world's languages, particularly creoles like Nagamese, remain severely under-resourced in Natural Language Processing (NLP), creating a significant barrier to their representation in digital technology. This paper introduces NagaNLP, a comprehensive open-source toolkit for Nagamese, bootstrapped through a novel methodology that relies on LLM-driven but human-validated synthetic data generation. We detail a multi-stage pipeline where an expert-guided LLM (Gemini) generates a candidate corpus, which is then refined and annotated by native speakers. This synthetic-hybrid approach yielded a 10K pair conversational dataset and a high-quality annotated corpus for foundational tasks. To assess the effectiveness of our methodology, we trained both discriminative and generative models. Our fine-tuned XLM-RoBERTa-base model establishes a new benchmark for Nagamese, achieving a 93.81\% accuracy (0.90 F1-Macro) on Part-of-Speech tagging and a 0.75 F1-Macro on Named Entity Recognition, massively outperforming strong zero-shot baselines. Furthermore, we fine-tuned a Llama-3.2-3B Instruct model, named NagaLLaMA, which demonstrates superior performance on conversational tasks, achieving a Perplexity of 3.85, an order of magnitude improvement over its few-shot counterpart (96.76). We release the NagaNLP toolkit, including all datasets, models, and code, providing a foundational resource for a previously underserved language and a reproducible framework for reducing data scarcity in other low-resource contexts.

Visit

arxiv.org

Tasks

named entity recognitionpart of speech tagginginformation extraction

Tags

Computation and Language

Similaires

TharuChat: Bootstrapping Large Language Models for a Low-Resource Language via Synthetic Data and Human ValidationBootstrapping Transliteration with Constrained Discovery for Low-Resource LanguagesSynthetic Data Generation Pipeline for Low-Resource Swahili Sentiment Analysis: Multi-LLM Judging with Human ValidationSynthetic Data and Annotation Projection for Low-Resource NER PerformanceDiversity in Zero-Shot Synthetic Data for Low-Resource Grammatical Error DetectionGenerative Adversarial Networks for Synthetic Data Augmentation in Low-Resource Language Modeling with Cross-Lingual Knowledge Transfer

TharuChat: Bootstrapping Large Language Models for a Low-Resource Language via Synthetic Data and Human Validation

The rapid proliferation of Large Language Models (LLMs) has created a profound digital divide, effec

Bootstrapping Transliteration with Constrained Discovery for Low-Resource Languages

Generating the English transliteration of a name written in a foreign script is an important and cha

Synthetic Data Generation Pipeline for Low-Resource Swahili Sentiment Analysis: Multi-LLM Judging with Human Validation

Synthetic Data and Annotation Projection for Low-Resource NER Performance

Cross-lingual Named Entity Recognition (NER) leverages knowledge transfer between languages to ident

Diversity in Zero-Shot Synthetic Data for Low-Resource Grammatical Error Detection

Grammatical Error Detection (GED) methods rely heavily on human annotated error corpora. However, th

Generative Adversarial Networks for Synthetic Data Augmentation in Low-Resource Language Modeling with Cross-Lingual Knowledge Transfer

Low-resource language modeling is a challenge addressed in this research using a Generative Adversar