Skip to content

@zanachka zanachka

Change the repository type filter

All

    Repositories list

    749 repositories

    • awesome-web-scraping

      Public
      List of libraries, tools and APIs for web scraping and data processing.
      Makefile
      •
      Other
      •787•0•0•0•Updated Oct 29, 2024Oct 29, 2024

    • web-scraper-chrome-extension

      Public
      Web data extraction tool implemented as chrome extension
      JavaScript
      •
      GNU Lesser General Public License v3.0
      •68•0•0•0•Updated Oct 29, 2024Oct 29, 2024

    • top-user-agents

      Public
      A list of most common User Agent used on Internet.
      JavaScript
      •
      MIT License
      •16•0•0•0•Updated Oct 29, 2024Oct 29, 2024

    • lol-html

      Public
      Low output latency streaming HTML parser/rewriter with CSS selector-based API
      Rust
      •
      BSD 3-Clause "New" or "Revised" License
      •83•0•0•0•Updated Oct 29, 2024Oct 29, 2024

    • tls-client

      Public
      net/http.Client like HTTP Client with options to select specific client TLS Fingerprints to use for requests.
      Go
      •
      BSD 4-Clause "Original" or "Old" License
      •163•0•0•0•Updated Oct 28, 2024Oct 28, 2024

    • scrapy-prometheus-exporter

      Public
      Scrapy stats exporter for prometheus
      Python
      •
      MIT License
      •11•0•0•0•Updated Oct 28, 2024Oct 28, 2024

    • adblocker

      Public
      Efficient embeddable adblocker library
      TypeScript
      •
      Mozilla Public License 2.0
      •101•0•0•10•Updated Oct 28, 2024Oct 28, 2024

    • storescraper

      Public
      Python
      •27•0•0•1•Updated Oct 27, 2024Oct 27, 2024

    • estela

      Public
      estela, an elastic web scraping cluster 🕸
      TypeScript
      •
      MIT License
      •13•0•0•0•Updated Oct 27, 2024Oct 27, 2024

    • selectolax

      Public
      Python binding to Modest engine (fast HTML5 parser with CSS selectors).
      Cython
      •
      MIT License
      •69•0•0•0•Updated Oct 26, 2024Oct 26, 2024

    • number-parser

      Public
      Parse numbers written in natural language
      text-extractionhtml-extraction
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •23•0•0•0•Updated Oct 25, 2024Oct 25, 2024

    • hero

      Public
      The web browser that’s nearly impossible for bot blockers to block
      TypeScript
      •
      MIT License
      •44•0•0•1•Updated Oct 25, 2024Oct 25, 2024

    • got-scraping

      Public
      HTTP client made for scraping based on got.
      TypeScript
      •44•0•0•0•Updated Oct 25, 2024Oct 25, 2024

    • scrapy-zyte-api

      Public
      Zyte Data API integration for Scrapy
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •19•0•0•0•Updated Oct 24, 2024Oct 24, 2024

    • scrapy-puppeteer-1

      Public
      Library that helps use puppeteer in scrapy.
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •3•0•0•0•Updated Oct 23, 2024Oct 23, 2024

    • solotodo_core

      Public
      Python
      •5•0•0•1•Updated Oct 23, 2024Oct 23, 2024

    • tlslite-ng

      Public
      TLS implementation in pure python, focused on interoperability testing
      Python
      •
      Other
      •80•0•0•0•Updated Oct 22, 2024Oct 22, 2024

    • creepjs

      Public
      Creepy device and browser fingerprinting
      TypeScript
      •
      MIT License
      •194•0•0•0•Updated Oct 20, 2024Oct 20, 2024

    • zyte-parsers

      Public
      HTML
      •
      MIT License
      •3•0•0•0•Updated Oct 20, 2024Oct 20, 2024

    • dukpy

      Public
      Simple JavaScript interpreter for Python
      JavaScript
      •
      MIT License
      •43•0•0•0•Updated Oct 20, 2024Oct 20, 2024

    • zyte-common-items

      Public
      Contains the common item definitions used in Zyte.
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •7•0•0•0•Updated Oct 20, 2024Oct 20, 2024

    • itemadapter

      Public
      Common interface for data container classes
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •13•0•0•0•Updated Oct 19, 2024Oct 19, 2024

    • zyte-spider-templates

      Public
      Spider templates for automatic crawlers.
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •4•0•0•0•Updated Oct 19, 2024Oct 19, 2024

    • w3lib

      Public
      Python library of web-related functions
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •104•0•0•0•Updated Oct 19, 2024Oct 19, 2024

    • scrapy-poet

      Public
      Page Object pattern for Scrapy
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •28•0•0•0•Updated Oct 19, 2024Oct 19, 2024

    • chrome-aws-lambda-layer

      Public
      43 MB Google Chrome to fit inside AWS Lambda Layer compressed with Brotli
      MIT License
      •46•0•0•0•Updated Oct 19, 2024Oct 19, 2024

    • proxy-chain

      Public
      Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.
      JavaScript
      •
      Apache License 2.0
      •144•0•0•10•Updated Oct 18, 2024Oct 18, 2024

    • scrapy-crawlera

      Public
      Crawlera middleware for Scrapy
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •88•0•0•0•Updated Oct 18, 2024Oct 18, 2024

    • web-poet

      Public
      Web scraping Page Objects core library
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •15•0•0•0•Updated Oct 18, 2024Oct 18, 2024

    • clear-html

      Public
      Remove DIVs, style stuff and normalize HTML preserving estructure information
      Python
      •
      MIT License
      •1•0•0•0•Updated Oct 17, 2024Oct 17, 2024