Knack-Scraper/README.md
quorploop bcd210ce01 Dockerized Scraper
- Implements Dockerized Version of Scraper
- Atomized tags and categories columns
2025-12-20 20:55:04 +01:00

279 B

Knack-Scraper does exacly what its name suggests it does. Knack-Scraper scrapes knack.news and writes to an sqlite database for later usage.

Example for .env

NUM_THREADS=8
NUM_SCRAPES=100
DATABASE_LOCATION='./data/knack.sqlite'

Run once

python main.py