Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
71,372 visible repositories in the index
1–24 of 129 · Most stars
Python scraper based on AI
Elegant Scraper and Crawler Framework for Golang
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
TranslatedProduction-grade platform for building agentic IM bots - Agent, knowledge base orchestration, plugin system / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信 (Qiye Weixin, "Enterprise WeChat"), 企微智能机器人 (Qiwei Zhineng Jiqiren, "Enterprise WeChat smart bot"), 公众号 (Gongzhonghao, "official account")) / 飞书 (Feishu, "flying book") / 钉钉 (Dingding, "nail nail") / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow
A 100% free modern JS SaaS boilerplate (React, NodeJS, Prisma). Full-featured: Auth (email, google, github, slack, MS), Email sending, Background jobs, Landing page, Payments (Stripe, Polar.sh), Shadcn UI, S3 file upload. AI-ready with tailored AGENTS.md, skills, and Claude Code plugin. One cmd deploy. Powered by Wasp full-stack framework.
The open-source hub to build & deploy GPT/LLM Agents ⚡️
ChatterBot is a machine learning, conversational dialog engine for creating chat bots
Build voice agents with open-source models
Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots
AutoHotkey - macro-creation and automation-oriented scripting utility for Windows.
A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
TranslatedWeekly Go Online Meetup via Bilibili|Go Night Reading|Share Go-related technical topics through live streaming on Bilibili, and every day everyone communicates and discusses programming topics in a timely way on WeChat/Telegram/Slack.
Connect APIs, remarkably fast. Free for developers.
Translated:orange_book: Chinese Xinhua Dictionary database. Includes xiehouyu (two-part allegorical sayings), idioms, words, and Chinese characters.
An Open-Source Asynchronous Coding Agent
RobotGo, Go Native cross-platform RPA, GUI automation, Auto test and Computer use @vcaesar
TranslatedA golang implementation of cqhttp, lightweight and natively cross-platform.
High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Go library for the WhatsApp web multidevice API
Pholcus is a distributed high-concurrency crawler software written in pure golang