Sign in

Repository Index

47,133 repositories indexed

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–9 of 9 · Most stars

jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.

Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.

  • crawling
  • csharp
  • elixir
  • ffi

TranslatedDeepSeek Blue Big Fat Fish Elimination Plan: a Chrome / Edge / Firefox browser extension that identifies and cleans up bot accounts (大肥鱼, Dafeiyu, "big fat fish") driven by the DeepSeek large model and AI agents in Bilibili comment sections. Offline rules + precise judgment by the DeepSeek API, AI comment detection, profile page identification, and one-click clearing by 鲸鱼娘 (Jingyuniang, "whale girl"). DeepSeek AI bot detector for Bilibili comments.

Open Source & Self-hosted Spotify release tracker. Auto-syncs new releases to playlists and includes power-user utilities like a discography generator and ghost track cleaner.