Logo Lanfrica
  • Home
  • Atlas
  • Insights
  • Docs
  • Sign in

© 2026 Lanfrica. All rights reserved. All copyrights of the resources shown on the Lanfrica website belong to the original copyright holders, unless explicitly stated otherwise.

Biomedical Machine Translation for Low-Resource Arabic-Script Languages via Cross-Lingual Transfer and LoRA Adapter Merging

Domain:

natural language processinghealthcare

Record type:

paper
Creator:
AlaEslHarHan
Host:avatar
We present a systematic study of healthcare-domain cross-lingual transfer to address the scarcity of biomedical NMT resources for Arabic-script languages. We use Arabic and Persian as higher-resource pivots to improve translation for \textbf{four severely low-resource} targets: Dari (Afghan Persian, a standardised variety of Persian), Pashto, Sorani Kurdish (Central Kurdish, a major standardized variety of Kurdish), and Urdu (closely related to Hindi). Using LoRA fine-tuning on small decoder-only LLMs, we train \textit{domain-specific pivot adapters} and evaluate \textbf{three transfer strategies}: few-shot in-context learning, minimal supervised adaptation, and, to the best of our knowledge, for the first time in this setting, zero-data LoRA adapter merging. Supervised adaptation with just 500 sentences achieves near pivot-language quality for Dari (CHrF++ 41.01) and meaningful gains for Urdu (28.88), while adapter merging reaches within 3.5 CHrF++ of supervised adaptation for Dari at zero additional cost. Pashto and Sorani Kurdish remain insufficient for high-stakes clinical deployment exposing the limits of cross-lingual transfer when structural distance from the pivots is too great. LoRA adapter merging works surprisingly well for closely related languages, even without target-language biomedical data.

Visit

arxiv.org

Tasks

machine translationtransfer learning

Languages

Pévé

Tags

Computation and Language

Similar

Improving Low-Resource Machine Translation via Cross-Linguistic Transfer from Typologically Similar High-Resource LanguagesEnhancing Cross-Lingual Transfer for Low-Resource Languages via Intermediate-Task TrainingCross-lingual Transfer Accuracy in Low-Resource Languages via Task SimilarityCross-Lingual Learning within Arabic Script for Low-Resource HTRCross-lingual Transfer Performance in Low-Resource Languages via Intermediate-Task TrainingGRASP LoRA: GRPO Guided Adapter Sparsity Policy for Cross Lingual Transfer

Improving Low-Resource Machine Translation via Cross-Linguistic Transfer from Typologically Similar High-Resource Languages

This study examines the cross-linguistic effectiveness of transfer learning for low-resource machine

Enhancing Cross-Lingual Transfer for Low-Resource Languages via Intermediate-Task Training

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Cross-lingual Transfer Accuracy in Low-Resource Languages via Task Similarity

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Cross-Lingual Learning within Arabic Script for Low-Resource HTR

Handwritten Text Recognition (HTR) with limited labeled data remains a challenging problem, particul

Cross-lingual Transfer Performance in Low-Resource Languages via Intermediate-Task Training

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

GRASP LoRA: GRPO Guided Adapter Sparsity Policy for Cross Lingual Transfer

Parameter efficient fine tuning is a way to adapt LLMs to new languages when compute or data are lim