A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
103,113 visible repositories in the index
1–24 of 102 · Most stars
A next-generation crawling and spidering framework.
MCP for xiaohongshu.com
Bridge local AI coding agents (Claude Code, Cursor, Gemini CLI, Codex) to messaging platforms (Feishu/Lark, DingTalk, Slack, Telegram, Discord, LINE, WeChat Work). Chat with your AI dev assistant from anywhere — no public IP required for most platforms.
A little like that j-thing, only in Go.
Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots
TranslatedWeekly Go Online Meetup via Bilibili|Go Night Reading|Share Go-related technical topics through live streaming on Bilibili, and every day everyone communicates and discusses programming topics in a timely way on WeChat/Telegram/Slack.
webhook is a lightweight incoming webhook server to run shell commands
RobotGo, Go Native cross-platform RPA, GUI automation, Auto test and Computer use @vcaesar
High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Pholcus is a distributed high-concurrency crawler software written in pure golang
A Chrome DevTools Protocol driver for web automation and scraping.
A flexible event/agent & automation system with lots of bees 🐝
TranslatedAn API framework with a modular design based on Gin, which wraps commonly used features, is simple to use, and is dedicated to fast business development. For example, it supports cors cross-origin requests, jwt signature verification, zap log collection, panic exception capture, trace link tracing, prometheus monitoring metrics, swagger document generation, viper configuration file parsing, the gorm database component, the gormgen code generation tool, the graphql query language, errno unified definition of error codes, the use of gRPC, cron scheduled tasks, and so on.
GitHub Agentic Workflows
Translated🎒 Feishu × (GPT-4 + GPT-4V + DALL·E-3 + Whisper) = a work experience that flies 🚀 Voice conversations, role-playing, multi-topic discussions, image creation, spreadsheet analysis, document export 🚀
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
Automate Docker container image updates
Swiss-army tool for scraping and extracting data from online assets, made for hackers
A scalable social community platform powered by Gin backend and modern TypeScript/Vue frontend architecture
Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes
Open source Uber
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more