In this project, we developed a multivariate forecasting solution to predict sales for a major Tunisian company. The dataset was initially unstructured, stored in scattered Word documents, requiring extensive data cleansing, transformation, and normalization to prepare it for analysis.
# π Problem Overview
The original dataset was unstructured and scattered across multiple Word documents. This required:
- π **Data cleansing and transformation**
- π **Normalization and unification** for analysis-ready formatting
---
# Workflow
# π§ Multivariate Sales Forecasting with Full MLOps Pipeline
## π Time Series Analysis
We performed a full time series analysis, including:
- π **Stationarity testing**
- π **Trend and seasonality detection**
We experimented with multiple **Machine Learning** and **Statistical models**:
- **Support Vector Machine (SVM)**
- **Linear Regression**
- **Vector Auto Regression (VAR)**
---
## π MLOps Pipeline Implementation
Once the optimal model was selected, we built and deployed a **full MLOps pipeline**, as illustrated in the diagram.
### π Data Versioning & Experiment Tracking
- `DVC`
- `MLflow`
- `DAGsHub`
### β
Model Testing & Validation
- `Deepchecks`
- `Pytest`
### π§© API Development & Deployment
- `FastAPI`
- `Docker`
- `Amazon ECR`
- `AWS ECS`
- `Elastic Load Balancer (ELB)`
### π‘ Monitoring & Drift Detection
- `Arize AI`
### π Visualization & Reporting
- `Streamlit`
- `GitHub Pages`
### βοΈ CI/CD Automation
- `GitHub Actions`
---
## β
Outcomes
This pipeline enabled:
- β‘ **Scalable deployment**
- π οΈ **Continuous monitoring**
- π¦ **Reproducibility & transparency**
- π **Rapid model iteration**
---
## π Tools & Technologies
| Category | Tools Used |
|--------------------------|----------------------------------------------------------------------------|
| Data Handling | Python, Pandas, NumPy |
| Modeling | SVM, Linear Regression, VAR |
| MLOps & Tracking | DVC, MLflow, DAGsHub |
| Testing & Validation | Deepchecks, Pytest β¦