Scrapy, a fast high-level web crawling & scraping framework for Python.
- python
- scraping
- crawling
- framework
Repository Index
47,133 repositories indexed
1–9 of 9 · Most stars
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.
- anti-detect
- bot-detection
- browser-automation
- chromium
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
- crawler
- dotnetcore
- cross-platform
- csharp
Crawly, a high-level web crawling & scraping framework for Elixir.
Telegram Bot API low level API and framework
This project focuses on automation of multi-level shadow root dom using java selenium. You can embed this plugin in your java selenium project.
- selenium
- selenium-webdriver
- selenium-java
- shadow-dom
Pre-rendering for JavaScript websites that delivers SSR-level SEO, enhanced link previews, and performance via effortless middleware integration — ideal for PWAs, SPAs, and modern JS-driven apps, websites, and webpages
- meteor
- middleware
- crawler
- seo
A high-level API to control headless Chrome or Chromium over the DevTools Protocol. It is the Rust equivalent of Puppeteer, a Node library maintained by the Chrome DevTools team.
SpiderMan,a base-on Broadway fast high-level web crawling & scraping framework for Elixir.