Logo Lanfrica
  • Home
  • Atlas
  • Insights
  • Docs
  • Sign in

© 2026 Lanfrica. All rights reserved. All copyrights of the resources shown on the Lanfrica website belong to the original copyright holders, unless explicitly stated otherwise.

A Transformer-Based Neural Machine Translation Model for Arabic Dialects That Utilizes Subword Units

Domain:

natural language processing

Record type:

model
Creator:
LaiIsaSey
Publisher:
MDP
Host:
Languages that allow free word order, such as Arabic dialects, are of significant difficulty for neural machine translation (NMT) because of many scarce words and the inefficiency of NMT systems to translate these words. Unknown Word (UNK) tokens represent the out-of-vocabulary words for the reason that NMT systems run with vocabulary that has fixed size. Scarce words are encoded completely as sequences of subword pieces employing the Word-Piece Model. This research paper introduces the first Transformer-based neural machine translation model for Arabic vernaculars that employs subword units. The proposed solution is based on the Transformer model that has been presented lately. The use of subword units and shared vocabulary within the Arabic dialect (the source language) and modern standard Arabic (the target language) enhances the behavior of the multi-head attention sublayers for the encoder by obtaining the overall dependencies between words of input sentence for Arabic vernacular. Experiments are carried out from Levantine Arabic vernacular (LEV) to modern standard Arabic (MSA) and Maghrebi Arabic vernacular (MAG) to MSA, Gulf–MSA, Nile–MSA, Iraqi Arabic (IRQ) to MSA translation tasks. Extensive experiments confirm that the suggested model adequately addresses the unknown word issue and boosts the quality of translation from Arabic vernaculars to Modern standard Arabic (MSA).

Visit

doi.org

Tasks

machine translation

Languages

Arabic, Libyan SpokenArabic, Moroccan Spoken

Licenses

https://creativecommons.org/licenses/by/4.0/

Similar

A Reverse Positional Encoding Multi-Head Attention-Based Neural Machine Translation Model for Arabic DialectsA Multitask-Based Neural Machine Translation Model with Part-of-Speech Tags Integration for Arabic DialectsA Transformer-Based Framework for Domain-Sensitive Amharic-English Neural Machine Translation With Character-Aware Subword EncodingDevelopment of a Transformer-Based Model for Amharic to English Neural Machine TranslationMachine Translation with Neural Networks Based on a TransformerA Transformer-Based Model for English to Yoruba Machine Translation

A Reverse Positional Encoding Multi-Head Attention-Based Neural Machine Translation Model for Arabic Dialects

Languages with a grammatical structure that have a free order for words, such as Arabic dialects, ar

A Multitask-Based Neural Machine Translation Model with Part-of-Speech Tags Integration for Arabic Dialects

The statistical machine translation for the Arabic language integrates external linguistic resources

A Transformer-Based Framework for Domain-Sensitive Amharic-English Neural Machine Translation With Character-Aware Subword Encoding

Development of a Transformer-Based Model for Amharic to English Neural Machine Translation

Machine Translation with Neural Networks Based on a Transformer

Over the same period, thanks to deep neural networks, particularly in machine translation tasks that

A Transformer-Based Model for English to Yoruba Machine Translation