76,356 visible repositories in the index
1–24 of 66 · Most stars
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Python ProxyPool for web spider
Conversational RPA SDK for Chatbot Makers. Join our Discord: https://discord.gg/7q8NBZbQzt
The premier source of truth powering network automation. Open source under Apache 2. Try NetBox Cloud free: https://netboxlabs.com/products/free-netbox-cloud/
Translated🤖 DIY-able multimodal AI chatbot | 🚀 Quickly connects to chat platforms such as WeChat, QQ, Telegram, and more | 🦈 Supports DeepSeek, Grok, Claude, Ollama, Gemini, OpenAI | Workflow system, web search, AI image generation, persona tuning, virtual maid, voice conversation |
TranslatedDouyin / TikTok platform tool for downloading works and collecting data
Pythonic HTML Parsing for Humans™
TranslatedXiaohongshu (XiaoHongShu, RedNote) link extraction / post collection tool
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
TranslatedA golang implementation of cqhttp, lightweight and natively cross-platform.
TranslatedAV movie management system, avmoo, javbus, javlibrary crawler, online AV movie library, AV magnet link database, Japanese Adult Video Library, Adult Video Magnet Links - Japanese Adult Video Database
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
TranslatedAsynchronous multi-platform chatbot framework written in Python
An Efficient ProxyPool with Getter, Tester and Server
TranslatedToday's Hot List (今日热榜), an aggregator website that gets the hot headlines from major popular websites. Written in Go, it uses multiple goroutines to fetch information asynchronously and quickly. Preview: https://mo.fish
ChatGPT for wechat https://github.com/AutumnWhj/ChatGPT-wechat-bot
Java wrapper for the popular chat & VOIP service: Discord https://discord.com
Lightweight, scriptable browser as a service with an HTTP API
Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS :performing_arts:
🔥 今日热榜 API，一个聚合热门数据的 API 接口，支持 RSS 模式 及 Vercel 部署 | 前端页面：https://github.com/imsyy/DailyHot
Slack Developer Kit for Python
All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
An unofficial .Net wrapper for the Discord API (https://discord.com/)