Sign in

Repository Index

57,138 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

337–360 of 491 · Most stars

A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library

  • golang
  • unmarshall
  • goquery
  • selectors

Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.

Z-Hound — a CSV-first collector that finds public threat reports and extracts structured IoCs without a database, LLM, or API key.

Self-hosted, invisible CAPTCHA that detects AI agents driving real browsers. GDPR, WCAG 2.2 AA, and EAA: no cookies, no third-party data sharing, and no visual or audio puzzle. With a false-positive budget enforced in CI. Proof of work, drop-in for Turnstile and reCAPTCHA.

  • anti-bot
  • behavioral-analysis
  • bot-detection
  • captcha

Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.

  • crawling
  • csharp
  • elixir
  • ffi