OtmanMOULAY/Review-Analytics-for-Bank-Branches-Morocco
Record type:
software
Creator:
Otm
Host:
# Review Analytics for Bank Branches in Morocco
A comprehensive data engineering and analytics solution for extracting, processing, and analyzing customer reviews for bank branches across Morocco. This project leverages modern data stack technologies to provide actionable insights into customer sentiment and banking service quality.
## 🏗️ Architecture Overview
This project implements a robust data pipeline using:
- **Airflow**: Orchestrates the entire data workflow
- **dbt**: Handles data transformation and modeling
- **Docker**: Ensures consistent deployment and environment management
- **Web Scraping**: Automated extraction of customer reviews from various platforms
## 🚀 Features
- **Automated Review Extraction**: Collects customer reviews from multiple sources
- **Data Quality Assurance**: Implements validation and cleansing processes
- **Sentiment Analysis**: Analyzes customer sentiment across different bank branches
- **Performance Metrics**: Tracks key performance indicators for banking services
- **Scalable Architecture**: Containerized solution for easy deployment and scaling
## 🛠️ Tech Stack
- **Orchestration**: Apache Airflow
- **Data Transformation**: dbt (Data Build Tool)
- **Containerization**: Docker & Docker Compose
- **Data Processing**: Python, Pandas
- **Database**: PostgreSQL
- **Monitoring**: Airflow UI for pipeline monitoring
## 📁 Project Structure
```
├── dags/
│ ├── DAG (include sentiment analysis)/ # Airflow DAGs
│ ├── data extraction/ # Custom Airflow plugins
│ └── data loading/ # Airflow configuration
├── dbt/
│ ├── models/ # dbt transformation models
│ ├── tests/ # Data quality tests
│ └── macros/ # Reusable dbt macros
├── Dockerfile # Container definitions
├── docker-compose.yml # Multi-service orchestration
└── docs/ # Documentation
```
## 🏃♂️ Quick Start
### Prerequisites
- Docker and Docker Compose installed
- Python 3 …