sarathsomana/indichateclassifier

A Hate classifier for low resource Indian languages # indic-hate-classifier A Hate classifier for low resource Indian languages ## DataSets This project uses datasets collected from various research papers and AI workshops. ### Dataset format | Column | Description | Format --|--|-- UID | Unique identifier to trace the origin of the dataset and act as index for dataset.| _ _ _ |text | The text content used for classifier | utf-8 encoded text |label_yn| A binary label indicating whether text is classified as hate / non-hate in respective datasets.| 1 - hate 0 - non-hate ### Sources Datasets used for each language are mentioned below. #### Hindi : 1. github.com 2. competitions.codalab.org 3. github.com 4. hasocfire.github.io #### Marathi : 1. github.com 2. github.com 3. github.com #### Telugu : 1. github.com ## Development Setup 1. Please install Poetry 2. Run `poetry install` in the project root to install required dependencies. 3. Run `poetry shell` to create a new poetry shell. 4. Run `jupyter notebook` to run jupyter notebook server.