Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
99,825 visible repositories in the index
1–18 of 18 · Most stars
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
Open-Source Unified Vulnerability Management, DevSecOps & ASPM
Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.
AutoKey, a desktop automation utility for Linux and X11.
A CLI utility for taking screenshots of websites, recording video demos and scraping sites using JavaScript
Network Automation and Programmability Abstraction Layer with Multivendor support
vulnx 🕷️ an intelligent Bot, Shell can achieve automatic injection, and help researchers detect security vulnerabilities CMS system. It can perform a quick CMS security detection, information collection (including sub-domain name, ip address, country information, organizational information and time zone, etc.) and vulnerability scanning.
Chaos Engineering Toolkit & Orchestration for Developers
A Python based web application scanner to gather OSINT and fuzz for OWASP vulnerabilities on a target website.
WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a corpus.
Spotify Music Downloader
Loki: Open-source solution designed to automate the process of verifying factuality
♾️ 开源数字永生框架 — 从聊天记录蒸馏任何人的七维数字分身。支持微信/飞书/iMessage/Telegram等12+平台,7种角色模板,对齐 OpenClaw Soul Spec 标准。一行指令让你的AI学会蒸馏。
660+ muapi-hosted generative-media models plus community-submitted third-party API tools (SEO, enrichment, social, scraping) — one YAML file per entry, browsable by capability.
ESB, SOA, REST, APIs and Cloud Integrations in Python
PhpStorm 2026 Standalone Desktop Setup with Full Feature Configuration
Community-driven Discord and Telegram bot full installer for offline desktop use