CityPulse: Real-Time Traffic Data Analytics and Congestion Prediction

Domaine:

mobility

Type de record:

papersoftwaredataset

Créateur:

TelSha

Hôte:

CityPulse is a proof-of-concept big data pipeline designed to enable real-time urban mobility analytics using scalable, containerized components -- without reliance on physical sensor infrastructure. The system simulates the ingestion of 11 million traffic-related records representing urban phenomena such as vehicle congestion, GPS coordinates, and weather conditions. Data is ingested through a Dockerized Apache Kafka cluster, coordinated by ZooKeeper, and processed in real time using Apache Spark Structured Streaming. To ensure robustness under load, the architecture introduces a temporary data storage layer that buffers Spark output before committing it to a centralized data warehouse. This design improves write efficiency, fault tolerance, and enables batch processing of intermediate results. The refined data feeds into a lightweight machine learning module and is served through a Flask backend with a React-based frontend for visualization and interaction. Stress testing shows that the system maintains over 300,000 records per minute throughput with only a 10\% increase in latency under full load conditions. With its modular Docker-based deployment, CityPulse offers a cost-effective and reproducible analytics solution for traffic congestion monitoring in resource-constrained environments, particularly in developing regions like Cameroon. 10

Visit

arxiv.org

Similaires

IoV distributed architecture for real-time traffic data analyticsNeural Network-Based Prediction of Traffic Accidents and Congestion Levels Using Real-World Urban Road DataA Real-Time Notification System for Traffic Congestion on South African National RoutesLACMAGO05/Intelligent-traffic-analysis-and-prediction-congestion-systemGeo-Visualization of Road Accident and Traffic Congestion Hotspots for Real-Time Traffic Optimization, Mobility Planning, and Commuters’ Safety Using Traffic Reported Social Media PostsTOWARDS AN EFFICIENT TRAFFIC CONGESTION PREDICTION METHOD BASED ON NEURAL NETWORKS AND BIG GPS DATA

IoV distributed architecture for real-time traffic data analytics

International audience In this paper, we present necessary premises for the deploymen

Neural Network-Based Prediction of Traffic Accidents and Congestion Levels Using Real-World Urban Road Data

This study presents a machine learning framework for predicting traffic accident occurrence and cong

A Real-Time Notification System for Traffic Congestion on South African National Routes

Transportation is an integral part of our daily life, and now with an ever increasing number of car

LACMAGO05/Intelligent-traffic-analysis-and-prediction-congestion-system

A system that analyzes traffic patterns and predicts congestion in the city of Buea, South-west, Cam

Geo-Visualization of Road Accident and Traffic Congestion Hotspots for Real-Time Traffic Optimization, Mobility Planning, and Commuters’ Safety Using Traffic Reported Social Media Posts

Amidst the bustling economic hub of Nigeria, known as Lagos, traffic congestion remains a persistent

TOWARDS AN EFFICIENT TRAFFIC CONGESTION PREDICTION METHOD BASED ON NEURAL NETWORKS AND BIG GPS DATA

ABSTRACT: The prediction of accurate traffic information such as speed, travel time, and congestion