55,640 visible repositories in the index
73–96 of 133 · Most stars
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt, eBay Kleinanzeigen and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.
Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.
Crawly, a high-level web crawling & scraping framework for Elixir.
Generate smart and powerful wordlists
Cross-platform port of Arx Fatalis, a first-person role-playing game
A scalable, mature and versatile web crawler based on Apache Storm
SEO foundation checks as an Agent Skill: give it a URL, get a crawler's-eye pass/fail report with evidence. 26 structural checks, zero LLM, deterministic.
Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
A high performance web crawler / scraper in Elixir.
Show an agent a problem: mark up, record, send
Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
TranslatedSelf-hosted web and AI crawler analytics for Generative Engine Optimization (GEO). Track visitors, AI search referrals, crawl logs, content coverage, and conversions. Jointly published by 猎看科技 (Liekan Technology, "hunt and see technology") · 北京日报社智源GEO (Beijing Daily Zhiyuan GEO, "Beijing Daily Press Zhiyuan GEO"). MIT licensed.
Java API For Chrome and Firefox
Scout: the open-source browser agent, by Outcrawl. Mirrored automatically from Outcrawl's own repository.
Extract structured data from web sites. Web sites scraping.
Translated✈️ Self-hosted multi-channel airfare price monitoring: flight detail collection → DingTalk rich-media push → four-layer strong alerts when the target price is met. Domestic routes and international routes (destinations on five continents) share the same collect-judge-push pipeline; data stays on your own machine, all configuration is done on a web page, open source and free.
PowerPoint .NET library for reading, modifying, and generating PPTX presentations without Microsoft Office
Xiryn — the open-source personal agent. Does everything Muse, Grok Bot and Dots do, on your own computer: each agent gets its own Linux desktop in Docker, any model with your keys, an encrypted vault, and control from Telegram.
teler-waf is a Go HTTP middleware that protects local web services from OWASP Top 10 threats, known vulnerabilities, malicious actors, botnets, unwanted crawlers, and brute force attacks.
WarcDB: Web crawl data as SQLite databases.
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.