OpenClaw-inspired autonomous AI agent built entirely in n8n. Adaptive RAG-powered memory, Skills via MCP templates, Expert Agents with delegated sub-agents, proactive task management, media understanding - self-hosted with one setup script
Repository Index
142,187 visible repositories in the index
553–576 of 627 · Most stars
Powerful and versatile game scraper written in c++
Scrapy Extension for monitoring spiders execution.
- scrapinghub
- scraping
- monitoring
- spiders
A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
- python
- awesome
- scrapy
- awesome-scrapy
NBA Stats API via Basketball Reference
- basketball-reference
- python
- nba
- web-scraping
Simple yet powerful automation stuffs.
- codetopdf
- comic-downloader
- instagram-scraper
- cricket-api
a reliable high-level web crawling & scraping framework for Node.js.
- scraping-framework
- crawler
- crawling
- headless-chrome
Jekyll-based static site for The Programming Historian
- programming-historian
- text-analysis
- api
- data-management
Web Scraping with GPT-4 Vision API and Puppeteer
R Package for Scraping and Aggregating NFL Data
A Set of Functions to Efficiently Scrape NFL Play by Play Data
- cran
- nfl
- r-package
- sports-analytics
Download an entire website from the Wayback Machine.
- archive-downloader
- archive-org
- ruby
- scraper
Python3 网络爬虫实践集合。涉及多类型验证码识别、多类型模拟登陆、多类型反反爬措施、APP数据抓取、Scrapy框架、分布式爬虫等。
eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay
- ebay
- ebay-api
- ebay-scraper
- python-web-scraper
Hand your SaaS growth chores to an agent: new-term radar, keyword-to-site discovery, competitor backlinks, directory submissions, plus a social analysis pack with a Douyin comments skill. Works with Grok Bot, Muse, Dot, Hermes, OpenClaw, Claude Code and Codex.
- agent-skill
- claude-code
- comments-scraper
- douyin
The unofficial HLTV Node.js API
Client-side media downloader App and CLI built with Capacitor and Node.js.
Browser automation engine benchmark - Test bypass rates, performance & stealth against Cloudflare, DataDome, reCAPTCHA, Kasada, Imperva, Akamai, PerimeterX and other bot detection systems. Find the best browser for scraping.
- anti-detect
- antidetect-browser
- automation
- browser
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
A dataset of millions of news articles scraped from a curated list of data sources.
Functional HTML scraping and rewriting with CSS in OCaml
Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.
- rvest
- rselenium
- httr
- scrape-websites
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.
The unix-way web crawler