AfriInstruct: Instruction Tuning of African Languages for Diverse Tasks

Domain:

natural language processing

Record type:

model

Creator:

AssCheLeeMad

Publisher:

Und

Host:

Large language models (LLMs) for African languages perform worse compared to their performance in high-resource languages. To address this issue, we introduce AfriInstruct, which specializes in instruction-tuning of multiple African languages covering various tasks. We trained the LLaMa-2-7B using continual pretraining and instruction fine-tuning, which demonstrates superior performance across multiple tasks. Our mixed task evaluation shows that our model outperforms GPT-3.5-Turbo and other baseline models of similar size. Our contributions fill a critical gap of LLM performance between high-resource and African languages.

Visit

doi.org underline.io

MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions

Instruction tuning enhances large language models (LLMs) by aligning them with human preferences acr

Scaling Diverse Intermediate Tasks for Zero-Shot Cross-Lingual Transfer in Low-Resource Languages

Zero-shot cross-lingual transfer is a central task in multilingual NLP, allowing models trained in l

mBART50 Fine-Tuning for Translation of South African Languages.

Performance Gains from Multilingual versus English-Only Intermediate Tasks on XTREME for Diverse Low-Resource Languages

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

iocuydi/amharic-visual-instruction-tuning

Dataset used for finetuning step of Amharic llava. More details: https://arxiv.org/abs/2403.06354

MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African Languages

In this paper, we present MasakhaPOS, the largest part-of-speech (POS) dataset for 20 typologically