kwoshvick/NSE-Stock-Price-Crawler
Domain:
socioeconomicRecord type:
dataset
Creator:
kwo
Host:
Nairobi Security Exchange (NSE) Kenya daily historical prices of all the stocks listed since 11 September 2006
# NSE Stock Price Crawler
This is a web crawler for Nairobi Security Exchange **(NSE)** Share prices since its digitization
on 11 th September 2006 to 28 th April 2022.
The data crawled can be found in the `data` folder.
**Setup**
- Install python3 and pip3 installed
```sh
pip3 install -r requirements.txt
```
- To install the python3 dependencies.
**Data Format in the csv**
* *Daily csv Format*
* Each csv contains daily prices for all the companies for that day.
* Code | Name | Lowest Price of the Day | Highest Price of the Day | Closing Price | Previous Day Closing Price | Volume Traded
* *Monthly , Yearly and Company csv Format*
* Each csv contains a particulars company prices for the month/ year
* Date | Lowest Price of the Day | Highest Price of the Day | Closing Price | Previous Day Closing Price | Volume Traded
The `data` folder has 4 folders inside:
* `Daily` folder
Has all NSE daily prices ordered by year and months
* `Monthly` folder
All daily data put in a single csv for that month ordered by company code name.
* `Yearly` folder
All monthly data put in a single csv for that year.
* `Company` folder
All yearly data put in a single csv for that company.
All errors *404* errors for pages not found can be found in the `errorlog` folder in the **error.log**
**NB** Unable to remove the following holidays as of now because they are dynamic
- Eid al Adha (was gazetted in Kenya as of September 2016)
- Eid Fitr
**Usage**
- To run the crawler
``` sh
python3 getData.py
```
**getData file**
- Set the following input
- Start month
- Start year
- End month
- End Year
- The script also does the following:
- The script crawls the data given the start dates and end dates.
It gets data from mystocks website , credits to them and saves them under the `data/daily/` folder.
- It gets each company's data from the daily csvs. It creates a csv for each company and saves the monthly share prices of that company. The data is stored in the `data/monthly/` folde …