Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
Repository Index
47,133 repositories indexed
25–48 of 1,018 · Most stars
Automate the process of making money online.
Make Any Website into CLI & Use your logged-in browser by AI agent.
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows. Used by 100,000+ builders.
We have made you a wrapper you can't refuse
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
- wget
- browser-bookmarks
- pinboard
AI agents, automations and apps that run your operations. Model agnostic.
- no-code-platform
- crud-app
- crud-application
- data-application
Let's use AI to Earn!
- auto-publish
- douyin
- electron-app
- electron-react
A powerful JavaScript library for interacting with the Discord API
An Open Phone Agent Model & Framework. Unlocking the AI Phone for Everyone
- agent
- phone-use-agent
TranslatedA complete and graceful API for Wechat. WeChat personal account API, WeChat robot, and command-line WeChat; you can customize a personal account robot in thirty lines.
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- web-scraping
- web-crawling
- npm
- headless-chrome
Zulip server and web application. Open-source team chat that helps teams stay productive and focused.
- zulip
- python
- python3
- chat
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Elegant Scraper and Crawler Framework for Golang
AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents
- workflow-automation
- mcp
- ai-agents
- mcp-tools
TranslatedA one-click tool for the daily tasks of Arknights, supporting all clients. (Arknights assistant: one click to finish all your daily tasks!)
- arknights
- maa
- computer-vision
Low-code programming for event-driven applications
- node-red
- javascript
- low-code
- openjs-foundation
Python ProxyPool for web spider
Conversational RPA SDK for Chatbot Makers. Join our Discord: https://discord.gg/7q8NBZbQzt
Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.
Home of the Renovate CLI: Cross-platform Dependency Automation by Mend.io
A WhatsApp client library for NodeJS that connects through the WhatsApp Web browser app
- whatsapp-web
- whatsapp-bot
- whatsapp-api