V-Ghost/SocialTrendsTracker

Data Engineering Project that accumulates, processes and analyses trends, topics and subjects of interest that have a pervasive online presence. This project strives to generate useful insight into the disperse categories of interest in the internet space in Ghana. # SocialTrendsTracker Data Engineering Project that accumulates, processes and analyses trends, topics and subjects of interest that have a pervasive online presence from disparate sources. This project strives to generate useful insight using data relating to trends on various social platforms in Ghana. It is written python and relies heavy on AWS Infastructure ## Table of Contents - Features - AWS Services - Architeture - Usage - Contributing - License ## Features - Extract trending topics/Media from platforms (Youtube,Twitter,Google,Spotify) using various APIs and upload into s3 datalake - Data Cleaning (Null/Missing Value Handlers,Parsing) - Data Transformations such as tokenization and vectorization is carried out. - Data Loaded into Repository - Angular Dashboard for analyzing data. ## Aws Services - AWS S3 - AWS Glue - AWS Lambda - AWS Step Function ## Architeture