Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

Biomedical Machine Translation for Low-Resource Arabic-Script Languages via Cross-Lingual Transfer and LoRA Adapter Merging

Domaine:

natural language processinghealthcare

Type de record:

paper
Créateur:
AlaEslHarHan
Hôte:avatar
We present a systematic study of healthcare-domain cross-lingual transfer to address the scarcity of biomedical NMT resources for Arabic-script languages. We use Arabic and Persian as higher-resource pivots to improve translation for \textbf{four severely low-resource} targets: Dari (Afghan Persian, a standardised variety of Persian), Pashto, Sorani Kurdish (Central Kurdish, a major standardized variety of Kurdish), and Urdu (closely related to Hindi). Using LoRA fine-tuning on small decoder-only LLMs, we train \textit{domain-specific pivot adapters} and evaluate \textbf{three transfer strategies}: few-shot in-context learning, minimal supervised adaptation, and, to the best of our knowledge, for the first time in this setting, zero-data LoRA adapter merging. Supervised adaptation with just 500 sentences achieves near pivot-language quality for Dari (CHrF++ 41.01) and meaningful gains for Urdu (28.88), while adapter merging reaches within 3.5 CHrF++ of supervised adaptation for Dari at zero additional cost. Pashto and Sorani Kurdish remain insufficient for high-stakes clinical deployment exposing the limits of cross-lingual transfer when structural distance from the pivots is too great. LoRA adapter merging works surprisingly well for closely related languages, even without target-language biomedical data.

Visit

arxiv.org

Tasks

machine translationtransfer learning

Languages

Pévé

Tags

Computation and Language

Similaires

Improving Low-Resource Machine Translation via Cross-Linguistic Transfer from Typologically Similar High-Resource LanguagesEnhancing Cross-Lingual Transfer for Low-Resource Languages via Intermediate-Task TrainingCross-lingual Transfer Accuracy in Low-Resource Languages via Task SimilarityCross-Lingual Learning within Arabic Script for Low-Resource HTRCross-lingual Transfer Performance in Low-Resource Languages via Intermediate-Task TrainingGRASP LoRA: GRPO Guided Adapter Sparsity Policy for Cross Lingual Transfer

Improving Low-Resource Machine Translation via Cross-Linguistic Transfer from Typologically Similar High-Resource Languages

This study examines the cross-linguistic effectiveness of transfer learning for low-resource machine

Enhancing Cross-Lingual Transfer for Low-Resource Languages via Intermediate-Task Training

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Cross-lingual Transfer Accuracy in Low-Resource Languages via Task Similarity

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Cross-Lingual Learning within Arabic Script for Low-Resource HTR

Handwritten Text Recognition (HTR) with limited labeled data remains a challenging problem, particul

Cross-lingual Transfer Performance in Low-Resource Languages via Intermediate-Task Training

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

GRASP LoRA: GRPO Guided Adapter Sparsity Policy for Cross Lingual Transfer

Parameter efficient fine tuning is a way to adapt LLMs to new languages when compute or data are lim