Logo Lanfrica

HichamDe/darija-offensive-language-detection

Domain:

natural language processing

Record type:

project
Creator:
Hic
Host:
# πŸš€ Offensive Message Detection in Arabic Darija This project focuses on building a **classification model** to determine whether a message is **offensive** or **not** in **Arabic Darija**. The model has practical applications, such as: βœ… **Filtering offensive comments** βœ… **Detecting hate speech & harmful content** --- ## πŸ“Œ Project Steps ### πŸ” 1. Data Gathering - πŸ“₯ Collected a **high-quality dataset** with labeled offensive and non-offensive messages. - πŸ”Ž Found an existing **Data set** online for reference. ### πŸ“Š 2. Exploratory Data Analysis (EDA) - Used **Pandas** to analyze and clean the dataset. - Identified missing values, text patterns, and class imbalances. ### πŸ— 3. Feature Engineering - Converted text data into numerical form using **Vectorization (TF-IDF / CountVectorizer)**. ### 🎯 4. Model Selection - Selected **Logistic Regression** as the classification model. ### βœ‚οΈ 5. Splitting Data - Split the dataset into **training (80%)** and **testing (20%)** for evaluation. ### πŸ“ˆ 6. Model Evaluation - Measured accuracy, precision, recall, and F1-score to validate performance. ### πŸ›  7. Running Custom Tests - Tested the model with **real-world Arabic Darija messages** to assess its accuracy. --- ## πŸš€ Future Improvements πŸ”Ή Train with a **larger dataset** for better accuracy. πŸ”Ή Experiment with **deep learning models (LSTMs, Transformers)** for improved results. πŸ”Ή Deploy the model as an **API** for real-time detection. --- ## πŸ›  Tech Stack Used - 🐍 **Python** - πŸ“Š **Pandas, NumPy** - πŸ€– **Scikit-learn** - πŸ“ **NLTK / Text Preprocessing Libraries** --- ## πŸ“’ Contributions & Feedback Feel free to contribute, suggest improvements, or test the model! πŸš€