Repository Index

Turn any website into a structured API. Extract, automate, search and monitor the web.

• automation
• no-code
• scraper
• web-scraper

A next-generation crawling and spidering framework.

• crawler
• web-spider
• gocrawler
• spider-framework

A lightweight, extendable front-end developer tool for mobile web page.

• wechat
• mobile
• console

Free, Open Source, Self-Hosted WhatsApp API Gateway

• api
• gateway
• whatsapp
• self-hosted

AWX provides a web-based user interface, REST API, and task engine built on top of Ansible. It is one of the upstream projects for Red Hat Ansible Automation Platform.

• python
• ansible
• django
• django-rest-framework

Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection

• ai-tools
• automation
• claude-ai
• claude-skills

Python version of the Playwright testing and automation library.

• playwright
• chromium
• firefox
• webkit

Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.

• docker
• chrome
• puppeteer
• browserless

Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots

• chat
• chat-application
• chatapp
• go

Browser automation and testing without limits. SeleniumBase's CDP Mode bypasses bot-detection with ease. Check out the examples!

• python
• selenium-python
• e2e-testing
• seleniumbase

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

• chromedriver
• selenium
• webdriver
• chrome

Python based web automation tool. Powerful and elegant.

• automation-framework
• python
• web-automation

Low-code platform allows you to build business apps, enables you to quickly create internal tools such as dashboard, crud app, admin panel, crm, cms, etc. Supports PostgreSQL, MySQL, Supabase, GraphQL, MongoDB, MSSQL, Rest API, Hugging Face, Redis, etc. Automate workflows with schedule or webhook. Open source Retool.

• internal-tool
• internal-tools
• gui
• typescript

TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.

• webcrawler
• scrapy
• crawlab
• spiders-management

webhook is a lightweight incoming webhook server to run shell commands

• webhook
• go
• devops
• deploy

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

• ai-agent
• anti-bot
• antidetect-browser
• automation

A scalable web crawler framework for Java.

• crawler
• java
• scraping
• framework

jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.

• jsoup
• html
• java
• dom

TranslatedA new-generation web crawler platform that defines crawler workflows graphically, so you can build a crawler without writing code.

• spider
• crawler
• jsoup
• xpath

Automated CAPTCHA solver for your browser. Works with Selenium, Puppeteer, Playwright, and more.

• perimeterx
• nopecha
• ai-agents
• anti-captcha

Capture website screenshots

The RSS feed for websites missing it

• php
• rss-bridge
• unlicense
• atom-feed

Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.

• python
• machine-learning
• natural-language-processing
• web-mining

Lighter web automation with Python

• selenium
• selenium-python
• python
• python3