This project scrapes the best-selling gaming mouse from Trendyol website and indexes the data into Elasticsearch to use the search engine. It allows for fuzzy searching of the indexed products.
-
Clone the repository: git clone https://github.com/yourusername/trendyol-scraper.git
-
Navigate to the project directory: cd trendyol-scraper
-
Install the required Python packages: pip install -r requirements.txt
-
Ensure you have Elasticsearch running locally and configure the connection parameters in the
create_elastic_clientfunction.
- To run the scraper, index data into Elasticsearch and searching: python trendyol_scraper.py
- Python 3.x
- Elasticsearch 7.x
.
βββ flags
β βββ indexing_done_37.flag # Flag file to check if indexing is done
βββ trendyol_scraper.py # Main Python script
βββ requirements.txt # Python dependencies
βββ README.md # This file
| No | File Name | Details |
|---|---|---|
| 1 | trendyol_scraper.py | Main script to scrape data and index into Elasticsearch |
| 2 | requirements.txt | List of Python dependencies |
| 3 | README.md | Project documentation |