Knowledge Distillation of BERT language model on the arabic language

The Impact of Arabic on Wolof Language

This research aims to study Wolof people in terms of their origin, background, and language. It will

State-of-the-Art Arabic Language Modeling with Sparse MoE Fine-Tuning and Chain-of-Thought Distillation

This paper introduces Arabic-DeepSeek-R1, an application-driven open-source Arabic LLM that leverage

The influence of the Berber language on Moroccan Arabic

PLNKicongo: Analysis of models based on the BERT architecture for processing the Angolan language Kicongo PLNKikongo: Analysis of models based on the BERT architecture for processing the Angolan language Kikongo

Pre-trained contextual language models have demonstrated excellent performance in training with data

ArabianGPT: Native Arabic GPT-based Large Language Model

The predominance of English and Latin-based large language models (LLMs) has led to a notable defici

Domain Specific Specialization in Low-Resource Settings: The Efficacy of Offline Response-Based Knowledge Distillation in Large Language Models

Large Language Models (LLMs) excel in general tasks but often struggle with hallucinations when hand