Repository Index

Elegant Scraper and Crawler Framework for Golang

• golang
• scraper
• framework
• crawler

A next-generation crawling and spidering framework.

• crawler
• web-spider
• gocrawler
• spider-framework

Bridge local AI coding agents (Claude Code, Cursor, Gemini CLI, Codex) to messaging platforms (Feishu/Lark, DingTalk, Slack, Telegram, Discord, LINE, WeChat Work). Chat with your AI dev assistant from anywhere — no public IP required for most platforms.

Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots

• chat
• chat-application
• chatapp
• go

A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.

• golang
• chrome
• chrome-debugging-protocol
• testing

TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.

• webcrawler
• scrapy
• crawlab
• spiders-management

webhook is a lightweight incoming webhook server to run shell commands

• webhook
• go
• devops
• deploy

scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

• golang
• google-maps-scraping
• web-scraper
• web-scraping

Go library for the WhatsApp web multidevice API

• go
• golang
• whatsapp
• whatsapp-web

Pholcus is a distributed high-concurrency crawler software written in pure golang

• spider
• crowler

A Chrome DevTools Protocol driver for web automation and scraping.

• cdp
• chrome-headless
• chrome-devtools
• chrome-devtools-protocol

GitHub Agentic Workflows

• gh-extension
• actions
• cai
• ci

Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application

• bugbounty
• crawling
• hacking
• osint

Swiss-army tool for scraping and extracting data from online assets, made for hackers

• css
• curl
• gjson
• json

TranslatedToday's Hot List (今日热榜), an aggregator website that gets the hot headlines from major popular websites. Written in Go, it uses multiple goroutines to fetch information asynchronously and quickly. Preview: https://mo.fish

• hot
• golang
• spider
• today-s-hot-list

A scalable social community platform powered by Gin backend and modern TypeScript/Vue frontend architecture

• forum
• go
• vue3
• bbs

Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes

• crawler
• proxypool

Open source Uber

• telegram
• ridesharing
• uber
• lyft

Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up

• ai
• anti-detect
• golang
• markdown

Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more

• endpoints
• endpoint-discovery
• bugbounty
• crawler

面向 AI Agent 的微信公众号创作与发布 CLI：Markdown 排版、AI 配图、预览与草稿创建；支持由浏览器 Agent 保存知乎、CSDN、头条未发布草稿。

• claude-skills
• markdown-converter
• wechat
• markdown-to-wechat

GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.

• agent-orchestration
• ai-agent
• ai-gateway
• anthropic

A modern IRC server (daemon/ircd) written in Go.

• irc-daemon
• sasl
• irc
• ircd

一款快速、全面、易用的页面信息提取工具，可快速发现和提取页面中的JS、URL和敏感信息。

• jsfinder
• urlfinder
• infofinder