Repository Index

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

• agent-infrastructure
• ai-agent
• ai-search
• automation

JavaScript API for Chrome and Firefox

• headless-chrome
• testing
• web
• developer-tools

Free, open source crypto trading bot

• python
• cryptocurrencies
• trading-bot
• telegram-bot

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.

• anti-detect
• bot-detection
• browser-automation
• chromium

We have made you a wrapper you can't refuse

• python
• telegram
• bot
• chatbot

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

• pocket
• wget
• browser-bookmarks
• pinboard

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

• web-scraping
• web-crawling
• npm
• headless-chrome

The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.

• agents
• ai
• playwright
• ai-agents

Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust

• browser
• rust
• servo
• browser-automation

✨ AI Spreadsheet for Business

• airtable
• airtable-alternative
• database
• no-code

TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.

• tiktok
• douyin
• scraper
• crawler

Command-line program to download image galleries and collections from several image hosting sites

• gallery
• downloader
• pixiv
• danbooru

TranslatedProduction-grade platform for building agentic IM bots - Agent, knowledge base orchestration, plugin system / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信 (Qiye Weixin, "Enterprise WeChat"), 企微智能机器人 (Qiwei Zhineng Jiqiren, "Enterprise WeChat smart bot"), 公众号 (Gongzhonghao, "official account")) / 飞书 (Feishu, "flying book") / 钉钉 (Dingding, "nail nail") / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow

• qq
• openai
• agent
• llm

A next-generation crawling and spidering framework.

• crawler
• web-spider
• gocrawler
• spider-framework

TranslatedDouyin / TikTok platform tool for downloading works and collecting data

• douyin
• python
• tiktok
• api

A 100% free modern JS SaaS boilerplate (React, NodeJS, Prisma). Full-featured: Auth (email, google, github, slack, MS), Email sending, Background jobs, Landing page, Payments (Stripe, Polar.sh), Shadcn UI, S3 file upload. AI-ready with tailored AGENTS.md, skills, and Claude Code plugin. One cmd deploy. Powered by Wasp full-stack framework.

• full-stack
• open-source
• saas
• nodejs

TranslatedAutomatically upload videos to social media: Douyin, Xiaohongshu, Shipinhao (WeChat Channels), TikTok, YouTube, Bilibili

• bilibili
• douyin
• tiktok
• xiaohongshu

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

• python
• news
• crawler
• crawling

Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.

• docker
• chrome
• puppeteer
• browserless

Download pictures (or videos) along with their captions and other metadata from Instagram.

• instagram
• instagram-client
• instagram-feed
• downloader

A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.

• golang
• chrome
• chrome-debugging-protocol
• testing

TranslatedXiaohongshu (XiaoHongShu, RedNote) link extraction / post collection tool

• python
• json
• linux
• macos

TranslatedAn online tool for batch downloading WeChat Official Account articles. It supports exporting read count and comment data, requires no environment setup, and can be used through an online website. It supports private deployment with docker and deployment on Cloudflare. It supports downloading various file formats, and the HTML format can restore article layout and styles 100%.

• download
• wechat
• wechat-article
• wechat-download

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

• chromedriver
• selenium
• webdriver
• chrome