Scrapy, a fast high-level web crawling & scraping framework for Python.
- python
- scraping
- crawling
- framework
132,241 visible repositories in the index
1–24 of 252 · Most stars
Scrapy, a fast high-level web crawling & scraping framework for Python.
Open-source foundation of ToolJet AI - the enterprise app generation platform for internal tools, dashboards, business applications, workflows and AI agents. Build visually, from a prompt, or from Claude Code, Codex and Cursor over MCP 🚀
🕵️♂️ Collect a dossier on a person by username from 6K websites
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
A powerful JavaScript library for interacting with the Discord API
Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.
A WhatsApp client library for NodeJS that connects through the WhatsApp Web browser app
A browser extension for automating your browser by connecting blocks
A next-generation crawling and spidering framework.
API Support for your favorite torrent trackers
A 100% free modern JS SaaS boilerplate (React, NodeJS, Prisma). Full-featured: Auth (email, google, github, slack, MS), Email sending, Background jobs, Landing page, Payments (Stripe, Polar.sh), Shadcn UI, S3 file upload. AI-ready with tailored AGENTS.md, skills, and Claude Code plugin. One cmd deploy. Powered by Wasp full-stack framework.
Proxy server to bypass Cloudflare protection
AWX provides a web-based user interface, REST API, and task engine built on top of Ansible. It is one of the upstream projects for Red Hat Ansible Automation Platform.
C# application with primary purpose of farming Steam cards from multiple accounts simultaneously.
Low-code platform allows you to build business apps, enables you to quickly create internal tools such as dashboard, crud app, admin panel, crm, cms, etc. Supports PostgreSQL, MySQL, Supabase, GraphQL, MongoDB, MSSQL, Rest API, Hugging Face, Redis, etc. Automate workflows with schedule or webhook. Open source Retool.
webhook is a lightweight incoming webhook server to run shell commands
Mautic: Open Source Marketing Automation Software.
The RSS feed for websites missing it
Modern Telegram Bot Framework for Node.js
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
💯 Teach puppeteer new tricks through plugins.
🤖 Keep your forks up-to-date via automated PRs
Translated🤖 wukong-robot is a simple, flexible, and elegant Chinese voice dialogue robot / smart speaker project. It supports ChatGPT multi-turn conversation, and may also be the first open-source smart speaker project to support brain-computer interaction.
The Unofficial TikTok API Wrapper In Python