Scrapy, a fast high-level web crawling & scraping framework for Python.
- python
- scraping
- crawling
- framework
47,133 repositories indexed
1–24 of 88 · Most stars
Scrapy, a fast high-level web crawling & scraping framework for Python.
The Secure CommsOS™ for mission-critical operations
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
A powerful JavaScript library for interacting with the Discord API
Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.
A WhatsApp client library for NodeJS that connects through the WhatsApp Web browser app
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
A browser extension for automating your browser by connecting blocks
TranslatedProduction-grade platform for building agentic IM bots - Agent, knowledge base orchestration, plugin system / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信 (Qiye Weixin, "Enterprise WeChat"), 企微智能机器人 (Qiwei Zhineng Jiqiren, "Enterprise WeChat smart bot"), 公众号 (Gongzhonghao, "official account")) / 飞书 (Feishu, "flying book") / 钉钉 (Dingding, "nail nail") / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow
A next-generation crawling and spidering framework.
A 100% free modern JS SaaS boilerplate (React, NodeJS, Prisma). Full-featured: Auth (email, google, github, slack, MS), Email sending, Background jobs, Landing page, Payments (Stripe, Polar.sh), Shadcn UI, S3 file upload. AI-ready with tailored AGENTS.md, skills, and Claude Code plugin. One cmd deploy. Powered by Wasp full-stack framework.
Proxy server to bypass Cloudflare protection
AWX provides a web-based user interface, REST API, and task engine built on top of Ansible. It is one of the upstream projects for Red Hat Ansible Automation Platform.
C# application with primary purpose of farming Steam cards from multiple accounts simultaneously.
Python based web automation tool. Powerful and elegant.
Low-code platform allows you to build business apps, enables you to quickly create internal tools such as dashboard, crud app, admin panel, crm, cms, etc. Supports PostgreSQL, MySQL, Supabase, GraphQL, MongoDB, MSSQL, Rest API, Hugging Face, Redis, etc. Automate workflows with schedule or webhook. Open source Retool.
webhook is a lightweight incoming webhook server to run shell commands
Mautic: Open Source Marketing Automation Software.
💬 Typebot is a powerful chatbot builder that you can self-host.
The RSS feed for websites missing it
Modern Telegram Bot Framework for Node.js
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
Golang bindings for the Telegram Bot API
A Rust library for the Discord API.