Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
47,133 repositories indexed
25–48 of 1,137 · Most stars
Python scraper based on AI
Automate the process of making money online.
Make Any Website into CLI & Use your logged-in browser by AI agent.
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows. Used by 100,000+ builders.
We have made you a wrapper you can't refuse
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
AI agents, automations and apps that run your operations. Model agnostic.
Let's use AI to Earn!
A powerful JavaScript library for interacting with the Discord API
An Open Phone Agent Model & Framework. Unlocking the AI Phone for Everyone
TranslatedA complete and graceful API for Wechat. A WeChat personal account API, WeChat bot, and command-line WeChat; you can customize a personal account bot in thirty lines.
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Zulip server and web application. Open-source team chat that helps teams stay productive and focused.
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Elegant Scraper and Crawler Framework for Golang
AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents
TranslatedArknights assistant, one-click for all your dailies! | A one-click tool for the daily tasks of Arknights, supporting all clients.
Low-code programming for event-driven applications
Python ProxyPool for web spider
Conversational RPA SDK for Chatbot Makers. Join our Discord: https://discord.gg/7q8NBZbQzt
Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.
Home of the Renovate CLI: Cross-platform Dependency Automation by Mend.io
A WhatsApp client library for NodeJS that connects through the WhatsApp Web browser app