Alazar-io/Text_Scraper

A Python-based web scraper using Playwright to extract and clean Amharic news articles from websites, designed for building dataset for NLP tasks. It can also be adapted for general-purpose web data collection and text processing pipelines. # Text_Scraper A simple Python web scraper built with Playwright to extract and clean Amharic news articles from websites. --- ## What it does - Scrapes web pages using Playwright - Cleans the page by removing unnecessary content such as tags and metadata - Extracts only useful Amharic text - Saves the result into a text file --- ## Why this project I built this to test a text summarization model using real Amharic news articles. It scrapes and cleans web text so I can use it for model evaluation and experiments. --- ## Requirements - Python 3.8+ - Playwright --- ## Installation Clone the repository: ```bash git clone github.com pip install playwright playwright install