Evaluating ChatGPT-4 and Machine Learning Models for Sentiment Analysis on a Multi-Script Moroccan Arabic Corpus: Insights, Challenges, and Future Directions

The application of Large Language Models (LLMs) to low-resource languages and dialects, such asMoroccan Arabic (MA), remains a relatively unexplored area. This study evaluates the performanceof ChatGPT-4, fine-tuned BERT models, FastText embeddings, and traditional machine learning approaches for sentiment analysis on MA. Using two publicly available MA datasets—the Moroccan Arabic Corpus (MAC) from X (formerly Twitter) and the Moroccan Arabic YouTube Corpus (MYC)—weassess the ability of these models to detect sentiment across different contexts. Although fine-tuned models performed well, ChatGPT-4 exhibited substantial potential for sentiment analysis, even in zero-shotscenarios. However, performance on MA was generally lower than on Modern Standard Arabic (MSA),attributed to factors such as regional variability, lack of standardization, and limited data availability. Future work should focus on expanding and standardizing MA datasets, as well as developing new methodslike combining FastText and BERT embeddings with attention mechanisms to improve performance onthis challenging dialect.