72,862 visible repositories in the index
169–192 of 227 · Most stars
Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Java API For Chrome and Firefox
Scout: the open-source browser agent, by Outcrawl. Mirrored automatically from Outcrawl's own repository.
Extract structured data from web sites. Web sites scraping.
3D engine that AI agents drive
Asynchronous WebSocket client
Translated✈️ Self-hosted multi-channel airfare price monitoring: flight detail collection → DingTalk rich-media push → four-layer strong alerts when the target price is met. Domestic routes and international routes (destinations on five continents) share the same collect-judge-push pipeline; data stays on your own machine, all configuration is done on a web page, open source and free.
PowerPoint .NET library for reading, modifying, and generating PPTX presentations without Microsoft Office
Xiryn — the open-source personal agent. Does everything Muse, Grok Bot and Dots do, on your own computer: each agent gets its own Linux desktop in Docker, any model with your keys, an encrypted vault, and control from Telegram.
teler-waf is a Go HTTP middleware that protects local web services from OWASP Top 10 threats, known vulnerabilities, malicious actors, botnets, unwanted crawlers, and brute force attacks.
WarcDB: Web crawl data as SQLite databases.
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.
The unix-way web crawler
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Mac app for website auditing and crawling
A UI/UX skill for coding agents to build distinctive, usable interfaces.
Native PC port of Super Smash Bros. Brawl (static recompilation): 4K, widescreen, gamepads, and Wii SD mods (Project+, Project+Ex, REX, Brawl Minus, Legacy XP). Bring your own disc.
Roguelite dungeon crawler game
TranslatedAll-in-one CLI & Skill to download anything: videos, docs, cloud drives, music, papers & books. An all-in-one download and archiving tool for AI Agents and terminals.
:vertical_traffic_light: Block malicious crawlers with Cloudflare Firewall Rules
A Payload CMS 3 plugin for Auth.js/NextAuth 5
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.