Abdo-Eid/Najeeb_chatbot

it's a chatbot for Digital Egypt e-platform for a UNI NLP project # Najeeb Chatbot - Egypt Digital Portal ## ✨ Our Story Najeeb was born out of a desire to simplify access to Egypt's Digital Portal services. Navigating government websites can be overwhelming, so we envisioned an intelligent assistant that could quickly answer user questions. By combining web scraping, data preprocessing, and a smart chatbot architecture, Najeeb provides a user-friendly way to get information about digital services in Egypt. ## 🎬 Demo --- ## ✅ Summary We have built a comprehensive pipeline that can be run any time. It can be customized for any website with small tweaks: 1. **Scraping:** Retrieves updated data. 2. **Preprocessing:** A simple but powerful process that resulted in a less than 1MB TF-IDF model and matrix for retrieval. - [ ] TODO: Can be enhanced later by using a morphological analyzer for lemmatization (achievable using Camel-tools). 3. **Chatbot:** A mix between rule-based and corpus/retrieval-based chatbots for better conversation and human interaction. 4. **API Integration:** A simple API integration for the UI. 5. **CLI Tool:** A CLI tool to handle the pipeline and server. An intelligent assistant that answers your questions about Egypt's Digital Portal services using web scraping, data preprocessing, and a combination of rule-based and TF-IDF retrieval chatbot logic. ## 🚀 Setup and Installation 1. **Clone the repository:** ```bash git clone github.com cd Najeeb_chatbot ``` 2. **Create a virtual environment (recommended):** ```bash python -m venv venv source venv/bin/activate # On Linux/macOS venv\Scripts\activate # On Windows ``` 3. **Install dependencies:** ```bash pip install -r requirements.txt ``` ## ⚙️ Configuration 1. **Configure `config.py`:** Review and adjust the file paths and chatbot rules in `config.py` to match your environment and desired chatbot behavior. ## 🛠️ Running the Pipeline The project includes a CLI tool (`manage.py`) to run different parts …