Popular repositories Loading

1. scrapy-splash scrapy-splash Public

   Scrapy+Splash for JavaScript integration

   Python 3.1k 452

2. scrapy-playwright scrapy-playwright Public

   🎭 Playwright integration for Scrapy

   Python 985 106

3. scrapy-djangoitem scrapy-djangoitem Public

   Scrapy extension to write scraped items using Django models

   Python 500 87

4. scrapy-zyte-smartproxy scrapy-zyte-smartproxy Public

   Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

   Python 357 88

5. scrapy-jsonrpc scrapy-jsonrpc Public

   Scrapy extension to control spiders using JSON-RPC

   Python 295 72

6. scrapy-deltafetch scrapy-deltafetch Public

   Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

   Python 265 48