Sign in

Repository Index

142,187 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

409–432 of 452 · Most stars

eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay

  • ebay
  • ebay-api
  • ebay-scraper
  • python-web-scraper

Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, verifiable data graphs, and evidence-grounded AI context.

A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library

  • golang
  • unmarshall
  • goquery
  • selectors

Self-hosted, invisible CAPTCHA that detects AI agents driving real browsers. GDPR, WCAG 2.2 AA, and EAA: no cookies, no third-party data sharing, and no visual or audio puzzle. With a false-positive budget enforced in CI. Proof of work, drop-in for Turnstile and reCAPTCHA.

  • anti-bot
  • behavioral-analysis
  • bot-detection
  • captcha

Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.

  • crawling
  • csharp
  • elixir
  • ffi